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PREFACE 


This  report  satisfies  the  requirements  for  Final  Report  (AOO^) 
under  contract  F2?60l -76-C-0 1 A5  (Laser  System  Reliability).  The  effort 
was  performed  by  Mr.  Paul  W.  Oueweke,  Or.  Robert  M.  Smith,  Dr.  Roger  K. 
Hoppe,  Mr.  Darrell  E.  Spreen,  Mr.  H.  George  Pringle,  and  Mr.  David  P. 
Vanarsdail  at  The  BDM  Corporation.  The  Project  Officer  was  Major  Jerry 
D.  Wilcox  vAFWL/PGA) . 


PROGRAM  SUMMARY 


To  briefly  summarize  Che  Laser  System  Rel lability  Program,  there 
are  four  areas  of  significant  contributions  to  the  reliability  effort. 

First,  a HEL  reliability  prediction  methodology  was  developed  which 
includes  some  new  concepts  in  the  areas  of  statistical  analysis  as 
applied  to  reliabilty  modeling.  The  methodology  is  general  enough  that 
it  can  be  applied  to  any  HEL  system  of  interest.  Both  the  physical 
description  and  the  failure  data  base  can  be  easily  modified  to  accom- 
modate both  changes  in  physical  configuration  such  as  redundancies  and 
deletion  or  addition  of  components,  and  changes  in  the  failure  data  used. 
The  mathematics  of  the  reliabilty  calculation  are  a modification  of  a 
classical  statistics  approach  developed  in  I9721.  The  technique  synthe- 
sizes a pseudo-number  of  trials  and  successes  for  a conceptual  HEL  system 
based  upon  existing  part  failure  rates.  A synthesis  technique  is  neces- 
sary because  the  HEL  system  under  Investigation  Is  nonexistent.  Thus, 
reliability  inferences  must  be  drawn  based  on  existing  data.  In  addition, 
the  approach  can  be  used  to  calculate  confidence  intervals  for  the  reli- 
ability point  estimates.  The  technique  can  handle  a system  of  any  com- 
plexity and  requires  no  sophisticated  computer  programs  for  evaluation. 

Second,  some  preliminary  reliability  point  estimates  and  their 
associated  lower  95  percent  confidence  bounds  were  calculated  for  three 
HEL  systems  based  upon  thf  physical  system  description  and  the  failure 
data  base  acquired. 

Third,  methodologies  were  developed  to  consider  cost  and  effective- 
ness as  they  apply  to  reliability  of  a conceptual  system.  An  original 
marginal  cost/marginal  benefit  analysis  was  developed  to  combine  the 
costs  and  benefits  due  to  LCC  and  availability  producing  a net  marginal 
cost  function  from  which  the  optimal  reliability  is  derived  (zero  net 
marginal  cost).  A simplified  combat  effectiveness  model  was  constructed 
to  relate  reliability  to  a measure  of  effectiveness  such  as  exchange 
ratio.  The  effectiveness  function  along  with  the  net  marginal  cost 
function  are  the  inputs  used  in  the  reliability  optimization.  . 


^Easterling,  R.  G.  "Approximate  Confidence  Limits  for  System  Reliability," 
Journal  of  the  American  Statistical  Association,  March  1972. 
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Fourth,  a reliability  apportionment  methodology  was  developed  which 
considers  both  the  criticality  of  parts  and  components  and  the  budgeting 
of  reliabilities  among  the  subsystems  and  components  to  achieve  the 
reliability  objective  defined  in  the  optimal  reliability  decision  process. 

A FMEA  (Failure  Nodes  and  Effects  Analysis)  was  developed  which  was  a 
modification  of  one  developed  by  the  SAE  (Society  of  Automotive  Engineers)2. 
A criticality  numbar  was  derived  from  the  FHEA  which  identifies  the 
importance  of  a subsystem  or  component  assuming  a failure  has  occurred 
(i.e.,  It  separates  criticality  Issues  from  reliability  issues).  Finally, 
a technique  was  developed  to  aid  In  the  reliability  apportionment  emong 
any  combination  of  subsystems  or  components. 


2Aerospace  Recommended  Practice  (AM  92ft),  "Design  Analysis  for  Failure 
Node,  Effects  and  Criticality  Analysis,"  SAE,  Saptember  15,  1967  (see 
Appendix  E,  Proposal  for  ISA,  ION  Corporation,  IDN/A-75-ft58-PAP-0IAl. 
26  April  1976). 


lv 


VitJ*##*; 


«.  ;*fl»S^rw*^  sma^momrrn^- 


CONTENTS 


Section  v.  page 

I INTRODUCTION  1 

A.  LASER  SYSTEH  RELIABILITY  PROBLEM  I 

B.  RELIABILITY  INTERACTION  WITH  MANAGEMENT  I 

C.  LASER  SYSTEM  RELIABILITY  PROGRAM  5 

0.  DEFINITIONS  8 

E.  ROADMAP  9 

II  PHYSICAL  SYSTEM  DESCRIPTION  10 


A.  INTRODUCTION  10 

B.  PHYSICAL  SYSTEM  DESCRIPTION  10 

C.  FUNCTIONAL  BLOCK  DIAGRAMS  II 

III  RELIABILITY  PREDICTION  METHODOLOGY  20 

A.  INTRODUCTION  20 

B.  RELIABILITY  BLOCK  DIAGRAM  AND  MOOEL  DEVELOPMENT  20 

C.  DATA  BASE  ASSEMBLY  26 

D.  FAILURE  CRITERIA  28 

E.  MOOEL  APPLICATION  29 

F.  LOWER  CONFIDENCE  BOUNDS  3*» 

IV  RELIABILITY  OPTIMIZATION  METHODOLOGY  38 

A.  INTRODUCTION  38 

B.  LIFE  CYCLE  COST  AND  AVAILABILITY  38 

1.  Introduction  38 

2.  Approach  39 

C.  COMBAT  EFFECTIVENESS  $0 

1.  Combat  Effectiveness  Algorithm  50 

2.  Impact  of  Reliability  on  HEL  Combat  Effectiveness  53 

D.  SUMMARY  OF  OPTIMIZATION  RELIABILITY  METHODOLOGY  5$ 

V RELIABILITY  APPORTIONMENT  METHODOLOGY  57 

A.  INTRODUCTION  57 

B.  DESIGN  GUIDELINES  57 

C.  SUBSYSTEM  CRITICALITY  RANKING  58 

1.  Failure  Mode  end  Effects  Analysis  59 

2.  Procedure  for  Criticality  Analysis  60 


v 


CONTENTS  (Concluded; 


Section  fiiS. 

0.  RELIABILITY  APPORTIONMENT  62 

1 . General  Methodology  62 

2.  . Single  Parameter  Apportionment  62 

3.  Multi  Parameter  Apportionment  64 

E.  SUMMARY  OF  RELIABILITY  APPORTIONMENT  METHODOLOGY  65 

VI  CONCLUSIONS  66 

A.  RELIABILITY  PREDICTION  METHODOLOGY  66 

1.  Physical  Description  66 

2.  Failure  Data  Base  67 

3.  Effects  on  the  Model  67 

h.  Operating  Time  68 

B.  RELIABILITY  OPTIMIZATION  METHODOLOGY  69 

C.  RELIABILITY  APPORTIONMENT  METHODOLOGY  70 

VII  RECOMMENDATIONS  71 

APPENDICES 

A FBD  MODIFICATIONS  75 

B FAILURE  RATE  DATA  BASE  81 

C DERIVATION  OF  PSEUOONUMBER  OF  TRIALS  APPROXIMATION  127 

D LOWER  CONFIDENCE  BOUNDS  CALCULATIONS  129 

E COMBAT  EFFECTIVENESS  ALGORITHM  136 

F COMBAT  EFFECTIVENESS  EXAMPLES  146 


■v 


vl 


i 


ILLUSTRATIONS 


Figure  Page 

1 Reliability  Interactions  with  HEL  Management  Program  4 

2 LSR  Task  Flowchart  6 

3 System  Description  Structure  12 

4 GDL  Functional  Block  Diagram  13 

5 CL  Functional  Block  Diagram  14 

6 EDL  Functional  Block  Diagram  15 

7 BCS  Functional  Block  Diagram  16 

8 FCS  Functional  Block  Diagram  17 

9 GDL  Reliability  Block  Diagram  21 

10  CL  Reliability  Block  Diagram  22 

11  EOL  Reliability  Block  Diagram  23 

12  BCS  Reliability  Block  Diagram  24 

13  FCS  Reliability  Block  Diagram  25 

14  Plot  of  Reliability  Estlmatas  for  Three  HEL  Systems  33 

15  Representative  Curves  of  Total  LCC  and  Marginal  LCC  42 

16  LCC  Data  for  Recant  Military  Aircraft  Acquisitions  44 

17  Availability  Versus  MTBF  46 

18  Relative  Cost  of  HEL  Fores  48 

19  Marginal  Benefit  from  Availability  48 

20  Generic  Probability  Tree  Diagram  for  Kill  Calculations  52 

21  Ral lability  Optimization  Methodology  '56 


vi  I 


W * ' 


i 


TABLES 


T«t>u  £sa« 

1 SOURCE/CONTACTS  FOR  FBD  DATA  19 

2 COMPOSITE  RELIABILITY  ESTIMATES  BY  SUBSYSTEM  30 

3 RELIABILITY  ESTIMATES  ANO  LOWER  95  PERCENT  CONFIDENCE  32 

BOUNOS 

k RELIABILITY  EFFECTS  ON  COMBAT  EFFECTIVENESS  5*» 

5 FAILURE  MODE  AND  EFFECTS  ANALYSIS  61 


SECTION  I 

INTRODUCTION 

A.  LASER  SYSTEM  RELIABILITY  PROBLEM 

Reliability  cons I derations  ere  Important  inputs  to  the  RSD  stage  of 
the  weapon  system  acquisition  cycle  since  they  provide  necessary  Inputs 
to  comparative  analyses,  cost/benefit  trade-offs,  end  system  simulations. 
In  addition,  the  DCP  (Development  Concept  Paper)  and  the  OSARC  (Defense 
Systems  Acquisition  end  Review  Council)  require  reliability  considera- 
tions to  support  the  management  decision  at  the  Secretary  of  Defense 
level.  The  Air  Force  Weapons  Laboratory  has  begun  a reliability  analysis 
effort  which  is  designed  to  meet  the  above  requirements  and  to  provide 
insights  Into  the  strengths  and  weaknesses  of  the  available  failure  data 
base  and  system  description.  The  ftrst  phase  of  this  reliability  pro- 
gram was  to  develop  e set  of  methodologies  addressing  reliability  and 
such  related  factors  as  life  cycle  cost  and  combat  effectiveness. 

The  remainder  of  this  chapter  addresses  the  following  topics: 

(1)  Presentation  of  the  relationship  between  reliability  and  the 
management  of  a HEL  weapon  system  acquisition. 

(2)  Brief  description  of  the  LSR  (Laser  System  Reliability) 
contract  effort, 

(3)  Definition  of  terms  used  In  the  development  of  the  technical 
approaches,  end 

(h)  Roadmap  to  direct  the  reader  through  the  rest  of  this  report. 

I.  RELIABILITY  INTERACTION  WITH  MANAGEMENT 

This  section  describes  how  reliability,  in  a general  sense,  plays 
into  the  overall  development  of  an  optimally  designed  HEL  weapon  system. 
From  this  description  a better  appreciation  will  be  developed  for  the 
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ways  in  which  reliability  cons  I derations  impact  costs,  benefits,  and 
management  decisions.  Figure  I presents  an  overall  flowchart  of  how  the 
reliability,  cost,  and  benefit  considerations  provide  critical  inputs  to 
the  HEL  Management  Program,  and  how  the  HEL  Management  Program  in  turn 
drives  toward  the  goal  of  generating  the  Optimal  HEL  Weapon  System 
Design. 

The  central  horizontal  thrust  of  figure  I begins  with  the  HEL 
Baseline  Oesign  and  ends  with  the  Optimal  HEL  Waapon  System  Oesign. 

This  Baseline  Oesign  may  be  a conceptual  design  such  as  that  derived 
from  Cycle  IV  or  from  the  SRAT  (Short  Range  Applied  Technology)  Program. 
The  HEL  Management  Program  will  probably  reside  In  different  places  as 
the  acquisition  matures.  The  HEL  Management  Program  provides  the 
decision  making  force  which  drives  the  system  from  a baseline  design  to 
the  optimal  design.  The  LCC  (Life  Cycle  Cost),  Availability,  and  Combat 
Effectiveness  considerations  which  flow  into  the  HEL  Management  Program 
perform  various  analytical  tasks  which  define  the  costs  and  the  benefits 
of  reliability  changes.  These  three  factors,  when  taken  together, 
provide  the  HEL  Management  Program  with  a ral lability  goal  which  is 
optimized  for  combat  effectiveness,  availability,  and  LCC. 

The  Reliability  Model  provides  the  reliability  inputs  to  these 
three  cost/benefit  analyses.  The  Reliability  Model,  In  turn,  is  con- 
structed by  consideration  of  the  next  higher  level  factors.  These 
factors  include  the  generation  of  a Functional  Block  Diagram,  a Reli- 
ability Block  Oiagram,  a Failure  Data  Base,  and  the  statistical  Con- 
fldenca  Bounds  on  the  reliability  Point  Estimates. 

Thus  the  structure  flowing  into  the  HEL  Management  Program  from 
abova  performs  the  function  of  analyzing  the  system  trade-offs  with 
respect  to  reliability  to  determine  a reliability  goal  for  achieving  the 
optimal  design. 
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The  level  flowing  Into  the  HEL  management  Program  from  below 
distirbutes  the  reliability  changes  among  the  HEL  subsystems  or  com- 
ponents. If  a system  is  composed  of  a number  of  subsystems,  it  would 
be  desirable  to  put  a reliability  goal  on  each  of  those  subsystems,  or 
on  the  appropriate  combination,  to  achieve  the  total  system  reliability 
goal . 

The  Subsystem  Reliability  Apportionment  has  two  inputs.  The  first  Is  a 
sat  of  Design  Guidelines  which  defines  the  engineering  techniques  which 
are  available  for  achieving  increased  reliability.  The  second  Is  a 
Criticality  Ranking  system  which  ranks  each  of  the  subsystems  in  terms 
of  Its  criticality  to  the  entire  HEL  system  assuming  that  a failure  of 
that  subsystem  h«s  occurred.  This  acknowledges  the  fact  that  failures 
of  some  subsystems  have  much  more  serious  repercussions  on  the  HEL 
system  than  do  failures  of  other  subsystems. 

Looking  at  the  flowchart  as  a whole  then,  one  can  see  three  main 
thrusts.  The  first  Is  the  thrust  towards  an  Optimal  HEL  Weapon  System 
Design  which  Is  driven  by  the  HEL  Management  Program.  The  second  thrust 
from  above  determines  the  reliability  goal  which  optimizes  the  Combat 
Effectiveness,  Availability,  and  Ufa  Cycle  Cost  of  the  system  and 
serves  as  an  Input  to  the  HEL  Management  Program.  This  reliability 
objective  is  the  product  of  a system  analyst  whose  task  is  to  answer  the 
question,  "What  is  the  reliability  objective  which  optimizes  the  system?" 
The  third  thrust  from  below  provides  the  necessary  inputs  for  determining 
how  the  reliability  goal  can  be  accomplished.  These  Inputs  are  developed 
by  the  system  designer  whose  task  is  to  answer  the  question,  "How  can  I 
achieve  this  reliability  objective?" 

The  entire  process  outlined  In  figura  I Is  not  a one-step  pro- 
cess, but  requires  a considerable  degree  of  Iteration  for  It  to  function 
effectively.  Thus,  the  system  analyst  may  be  required  to  perform  e 
number  of  analyses  based  upon  complicated  options  presented  by  the 
system  designer.  Even  more  significantly,  the  HEL  program  manager  may 
require  several  Iterations  of  the  reliability  goal  and  the  reliability 
apportionment  before  he  Is  satisfied  that  the  overall  HEL  mission  Is 
best  served. 

Figure  1,  then,  demonstrates  the  importance  of  the  reliability 
function  in  the  design  of  a complete  weapon  system,  it  shows  how  the 
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re)  lability  cone  I derat  Ions  directly  Influence  the  cost  and  benefit  con- 
siderations, and  how  these  in  turn  influence  the  HEL  Management  Program 
whose  goal  is  to  achieve  an  optimal  weapon  system  design.  Other  studies 
have  concluded  that  early  consideration  of  reliability  in  a weapon  sys- 
tem acquisition  cycle  can  save  significant  amounts  of  LCC  and  also 
increase  the  effectiveness  and  the  availability  of  the  force.3  This 
reliability  awareness  must  begin  very  early  in  the  acquisition  cycle  so 
that  system  design  options  will  not  be  precluded. 

C.  LASER  SYSTEM  RELIABILITY  PROGRAM 

The  LSR  contract  was  a 4-month  effort  which  addressed  the  major 
areas  which  both  influence,  and  are  influenced  by,  reliability.  This 
initial  effort  was  specifically  oriented  toward  developing  reliability 
methodologies  rather  than  toward  performing  complete  reliability  analy- 
ses with  accurate  numerical  predictions.  Thus,  the  development  of  tech- 
niques for  a wide  range  of  reliability  considerations  was  emphasized. 

A reliability  model  was  developed  and  a sufficiently  detailed  failure 
data  base  was  established  to  allow  application  of  the  model  to  the  three 
principal  HEL  systems  under  consideration:  the  GOL  (gas  dynamic  laser), 

the  CL  (chemical  laser),  and  the  EDL  (electrical  discharge  laser).  Then 
methodologies  were  developed  for  treating  the  interactions  of  reli- 
ability with  such  closely  related  factors  as  life  cycle  cost  and  combat 
effectiveness.  This  philosophy  has  resulted  tn  a study  with  an  extremely 
wide  scope,  but  with  a very  low  level  of  detail.  Figure  2 shows  a 
flowchart  of  the  three  tasks  In  this  contract. 


3"Dormant  Operations  and  Storage  Effects  on  Electronic  Equipment  and 
Part  Re! lability,1 " RADC-TR-66-3M,  Contract  AF  30 (602) -3772 , October 
1966. 
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Figure  2.  LSR  Task  Flowchart 


Task  I was.  to  accurately  describe  a conceptual  HEL  system  which 
would  be  used  for  a SRAT  mission  (t.e.,  the  kind  of  system  which  more 
closely  approximates  a weapon  system  rather  than  a laboratory  system). 
This  physical  system  description  decomposed  the  HEL  system  Into  three 
major  subsystems:  the  laser  device  or  beam  generator,  the  BCO  (beam 

control  optics),  and  the  FCS  (fire  control  system).  The  laser  devices 
described  were  the  GDL,  the  CL,  and  the  EOL.  These  five  subsystems  were 
then  further  decomposed  Into  the  components  and  finally  to  the  part 
level  of  detail.4  The  resultant  FBD  (functional  block  diagram)  shows 
how  alt  of  these  subsystems  and  components  interact  with  each  other  to 
generate  the  three  HEL  systems. 

Task  2 was  to  develop  a reliability  prediction  methodology.  First, 
an  RBD  (reliability  block  diagram)  was  developed,  the  purpose  of  which 
was  to  show  the  failure  relationships  among  subsystems  and  components  so 
that  the  effects  of  a failure  could  be  readily  traced  through  the  HEL 
system.  Next,  a failure  data  base  was  developed.  The  major  sources  of 
this  data  base  were  the  GIDEP  (Government  Industry  Oata  Exchange  Program), 
the  RADC  (Borne  Air  Development  Center)  Non-Electronic  Bel  lability  Note- 
book, a variety  of  open  literature  publications  and  Government  reports. 


4The  definitions  of  the  terms  "system,"  "subsystem,"  "component,"  and 
"part"  are  vary  important  to  the  understanding  of  the  approaches  devel- 
oped later;  so  these  terms  are  concisely  defined  In  section  D of  this 
chapter. 


and  various  internal  documents  at  the  ARTO  (Advanced  Radiation  Tech- 
nology Office) . 

Then  the  reliability  equation  was  derived  for  each  of  the  subsys- 
tems, thus  defining  five  reliability  functions  In  terms  of  the  component 
reliabilities.  This  set  of  reliability  equations,  along  with  the  tech- 
nique for  generating*  the  reliability  estimates  from  the  failure  data 
base,  constitutes  the  actual  reliability  model.  The  reliability  model 
was  then  applied  to  the  three  HEL  systems  to  calculate  reliability  point 
estimates  for  each  one.  In  addition,  the  statistical  confidence  bounds 
of  the  reliability  estimates  were  calculated. 

Task  3 was  to  develop  methodologies  for  the  consideration  of  a 
number  of  important  reliability  related  factors.  These  factors  were 
divided  into  two  parts:  (I)  the  reliability  optimization,  and  (2)  the 

reliability  apportionment. 

The  reliability  optimization  was  performed  by  analyzing  the  costs 
and  the  benefits  attributed  to  changes  in  reliability  of  the  HEL  system. 
A methodology  was  developed  to  use  historical  LCC  data  for  previous 
weapon  systems  in  order  to  determine  the  sensitivity  of  LCC  to  reli- 
ability. The  benefits  were  decomposed  into  two  parts:  the  dollars 

saved  from  force  reduction  due  to  availability  Increasa  with  an  Increase 
In  reliability,  and  the  exchange  ratio  Increasa  due  to  increased  combat 
effectiveness  as  a result  of  reliability  Increases. 

The  reliability  apportionment  was  partitioned  Into  three  parts. 

The  first  was  to  identify  specific  design  guidelines,  that  is,  engi- 
neering methods  for  increasing  system  reliability.  The  second  was 
to  perform  a criticality  ranking  which  could  be  applied  to  the  sub- 
systems or  components,  thus  ranking  them  in  order  of  importance  to 
the  HEL  system  should  a failure  occur.  Third,  a reliability  appor- 
tionment technique  was  developed  which  assists  in  budgeting  the 
optimal  reliability  goal  among  the  various  subsystems  and  components. 
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D.  DEFINITIONS 

The  h 

ierarchy  of  levels  of  the  physical  system  breakdown 

plays  an 

important 

role  in  the  total  understanding  of  the  methodologies 

to  be 

descr i bed 

in  detail  in  later  chapters  of  this  report.  Thus,  i 

t i s 

advi sabl e 

here  Lo  define  these  levels  for  future  reference. 

NUMBER  OF 

ELEMENTS  IN 

LEVEL 

EXAMPLE 

THIS  LEVEL 

System 

HEL 

1 

Subsystem 

Beam  Control  System 

5 

Component 

Servo-Hydraulic  Drive 

91 

Part 

Hvdraul ic  Pump 

273 

In  addition,  the  following  acronyms  will  be  used  throughout  the  report: 

ARTO 

Advanced  Radiation  Technology  Office 

ALL 

Airborne  Laser  Laboratory 

BCS 

Beam  Control  System 

CL 

Chemical  Laser 

F.DL 

Electrical  Discharge  Laser 

ER 

Exchange  Ratio 

FBD 

Functional  Block  Diagram 

FCS 

Fire  Control  System 

GDL 

Gas  Dynamic  Laser 

HEL 

High  Energy  Laser 

LSR 

Laser  System  Reliability 

LCC 

Life  Cycle  Cost 

LWS 

Light  Weight  System 

RBD 

Reliability  Block  Diagram 

SRAT 

Short  Range  Applied  Technology 

3 


ROADMAP 


The  remainder  of  this  report  will  discuss  the  following  items: 

(1)  Development  of  the  methodologies  Including: 
e)  Functional  block  diagrams 

b)  Model  and  failure  data  base 

c)  Rel labi I ity  optimization 

d)  Rel iabi I ity  apportionment 

(2)  Conclusions  derived  from  the  technical  effort. 

(3)  Recommendations. 
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SECTION  II 

PHYSICAL  SYSTEM  DESCRIPTION 


A.  INTRODUCTION 

This  chapter  presents  the  physical  system  description  that  was  used 
to  describe  the  HEL  system  prior  to  the  construction  of  the  reliability 
model  itself.  This  chapter  includes  the  results  of  task  I as  It  was 
outlined  In  chapter  I.  The  end  product  of  the  task  was  a functional 
block  diagram  of  a HEL  weapon  system.  These  functions*  block  diagrams 
are  presented  elong  with  the  reasons  why  certain  choices  were  made  in 
their  development. 

B.  PHYSICAL  SYSTEM  DESCRIPTION 

Although  the  functional  reliability  of  a HEL  system  Is  the  ultimate 
objective  of  this  study,  one  must  approach  this  objective  by  Investigat- 
ing the  reliabilities  of  the  Individual  subsystems,  components,  and 
parts.  One  cannot  perform  the  analysis  on  functions  because  functions 
are  abstract  and  can  be  performed  by  more  than  one  set  of  physical 
components.  The  functional  reliability  depends  upon  which  unique  set  of 
components  Is  chosen  to  perform  the  function.  For  example,  the  threat 
acquisition  function  can  be  performed  by  the  pilot  with  a pair  of  bin- 
oculars or  by  a phased  array  radar  system.  Obviously,  the  functional 
reliability  (l.e.,  the  reliability  of  the  acquisition  function)  depends 
heavily  on  which  of  the  two  techniques  is  used.  Thus,  one  must  first 
transfer  the  function  into  a physical  system  description  used  to  achieve 
that  function  and  then  consider  the  reliabilities  of  the  Individual 
subsystems,  components,  and  parts.  These  reliabilities  can  then  be 
combined  to  yield  the  reliability  of  the  function. 

The  technique  of  physical  component  breakdown  may  be  further  com- 
plicated by  the  additional  requirement  of  correspondence  between  the 
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physical  components  and  the  functions.  Ideally,  one  would  desire  that  a 
particular  function  be  uniquely  related  to  a particular  fixed  set  of 
physical  components.  If  a single  component  contributes  to  more  than  one 
function,  then  the  task  of  determining  that  component's  reliability 
relative  to  each  function  becomes  potentially  very  difficult. 

In  this  study,  this  problem  was  avoided  altogether  by  the  Judicious 
choice  of  functional  and  component  breakdowns.  One  requirement  was  that 
there  be  a one-to-one  correspondence  between  a function  and  a set  of 
components.  Secondly,  the  interfaces  among  components,  either  within 
the  same  function  or  between  two  different  functions,  were  carefully 
chosen,  both  to  be  realistic  and  to  minimize  the  practical  and  mathe- 
matical problems  associated  with  both  defining  and  operating  with  the 
reliabilities  of  intercomponent  functions.  Thus,  the  physical  component 
description  was  constructed  considering  the  constraint  that  this  one-to- 
one  correspondence  between  components  and  functions  had  to  be  maintained. 
For  this  reason,  the  functional  block  diagrams  resulting  from  the  study 
are  Identical  to  the  physical  system  descriptions. 

The  structure  of  the  physical  system  description  Is  presented  In 
figure  3.  This  figure  shows  the  four  levels  of  the  breakdown  that 
were  defined  In  chapter  I. 

C.  FUNCTIONAL  BLOCK  DIAGRAMS 


Since  the  HEL  system  Is  quite  complex,  a separate  FID  was  prepared 
for  each  subsystem  (i.e.,  there  are  five  FBD's:  GDL,  CL,  EOL,  BCS,  and 

FCS).  These  five  FBD's  are  presented  in  figures  k to  8.  These  FBD's 
represent  a logical  breakdown  of  the  subsystems  at  the  component  level. 
Due  to  constraints  in  the  failure  data  base,  however,  the  complexity 
of  each  component  is  not  reflected  In  *.he  component  breakdown  of  parts. 
The  ultimate  parts  breakdown  would  probably  show  the  BCS  and  the  FCS 
to  have  a larger  number  of  parts  than  any  of  the  beam  generating  sub- 
systems. 
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Figure  DDL  Functional  Block  Diagram 
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CL  Functional  Block  Diagram 
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FIRE  CONTROL  SYSTEM 


Figure  8.  FCS  Functional  Block  Diagram 


The  system  configurations  prasantad  In  thata  ftguras  ara  tha 
rasults  of  conversations  with  Individuals  In  each  of  tha  subsystem 
areas.  Table  1 presents  the  sources  of  the  FBD  data.  In  addition 
to  these  personal  contacts , a number  of  AFVA.  and  ASD  reports  ware 
examined. 

Tha  configurations  of  tha  subsystems  ware  chosen  to  be  representa- 
tive of  a SRAT  mission.  Thus,  It  was  desired  that  tha  system  look  more 
like  a weapon  system  than  Ilka  a laboratory  system.  Since  tha  SRAT  sub- 
systems ara  vary  conceptual  at  this  point,  many  of  tha  components  In  the 
subsystems  ara  vary  uncertain.  In  addition,  many  of  tha  components  are 
vary  mission  dependant.  Since  this  modal  is  to  have  broad  application, 
tha  attempt  was  made  to  Include  any  components  for  any  mission  that 
might  be  performed  by  SRAT.  Than  certain  components  can  be  delated  from 
tha  FBD  for  application  to  a specific  mission. 

Tha  level  of  detail  of  the  functional  block  diagrams  was  dictated 
by  three  constraints: 

(1)  Completeness  of  the  conceptual  designs. 

(2)  Completeness  end  applicability  of  the  failure  data  base 
available. 

(3)  Resources  available  under  the  contract  effort. 

It  will  be  seen  from  the  discussion  of  the  failure  data  base  In  chapter  III 
that  the  availability  of  failure  data  was  the  principal  constraint 
leading  to  the  termination  of  the  physical  system  description  at  the 
parts  level.  This  level  of  detail  is  not  seen  In  the  functional  block 
diagrams  presented  In  this  chapter,  however  the  parts  level  Is  presented 
in  chapter  III. 
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TABLE  I . SOURCE/CONTACTS  FOR  FBO  OATA 


GENERAL 

GDL 

EDL 

CL 

BCS 

FCS 


MAJ.  JERRY  D.  WILCOX 

DR.  STEVE  G.  HADLEY 

MR.  JACK  COLBERT  (PRATT  & WHITNEY) 

MR.  MIKE  McHALE  (ROCKETDYNE) 

LT.  COL.  PETER  0.  TANNEN 
MAJ.  FRANK  S.  ZIMMERMAN 
MAJ.  RICHARD  C.  OLIVER 
CAPT.  GEORGE  W.  MAYES 

OR.  LEROY  E.  WILSON 
CAPT.  JOHN  O' PRAY 
CAPT.  LARRY  D.  BUELOW 

LT.  COL.  RONALD  F.  PRATER 
LT.  COL.  R.  DALE  NEAL 
MAJ.  KEN  C.  JUNGLING 
MAJ.  OREST  R.  GOGOSHA 

MAJ.  DAVID  G.  NEALE 
CAPT.  RANDALL  D.  GODFREY 
CAPT.  JOHN  E.  ACTON 
MR.  DAVE  B.  LEMMING  (ASD) 


SECTION  III 

RELIABILITY  PREDICTION  METHODOLOGY 


A.  INTRODUCTION 


This  chapter  peasants  tha  ral lability  pradiction  methodology  usad 
to  ganarata  ral  lability  point  estimates  from  tha  FBD.  Tha  mathodology 
Includas  tha  construction  of  tha  RBD,  tha  assambty  of  a fatlura  data 
basa,  and  tha  calculation  of  lower  confidanca  bounds  on  tha  pot  it 
astlmatas.  Rasul ts  of  tha  modal  application  to  tha  GDL,  CL,  and  EDL  sys 
tarns  ara  prasantad,  and  tha  failure  criteria  are  discussed. 

B.  RELIABILITY  BLOCK  DIAGRAM  AND  MODEL  DEVELOPMENT 


A Reliability  Block  Olagram  was  generated  directly  from  each  PBD. 

Tha  five  RBO  ara  shown  In  figures  9 through  13.  A reliability  equa- 
tion is  prasantad  for  each  subsystem.  Tha  five  subsystem  ral labili- 
ties are  denoted  gfi(R),  g^(R) , gc(R),  g^(R) , and  g^(R)  for  tha  GOL,  EDL, 
CL,  8CS,  and  FCS,  respectively,  where  R ts  a vector  whose  components  ara 
tha  component  reliabilities  which  comprise  tha  subsystems.  Tha  subsystem 

A 

reliability  Is  thus  related  to  tha  point  estimates,  Rj,  of  each  of  Its 
components  through  this  relationship.  Each  of  the  three  HEL  system 
reliabilities  will  be  denoted  GQ(R),  Gg(R),  and  Gg(R),  respectively,  for 
the  GDL  system,  the  EDL  system,  and  the  CL  system.  The  G(R)  are  con- 
structed as  follows: 


v*>  - 

GC(R)  • 
6C(R)  - 


[«,<«]  [9,  w]  [,,<«>] 

[,,(«)]  [»,(«)]  [,,(«)] 

[«,<*>]  [*»] 


(Eq.  D 


Figure  9.  GDL  Reliability  Block  Diagr 
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Figure  10.  CL  Reliability  Block  Diagram 


Figure  II.  EDL  Reliability  Block  Diagram 


Figure  12.  BCS  Reliability  Block  Diagram 


25)  AFT  RAOAR  30)  FORWARD  RADAR 

26)  INERTIAL  NAVIGATION  SYSTEM  31,  32)  COMPUTER  (2  REDUNDANT  SYSTEMS) 
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Since  the  failure  data  base,  which  was  assembled  to  determine  these 
Rj,  was  composed  only  of  failure  rates  (l.e.,  number  of  failures  per  10 
part-hours  of  testing),  tt  was  necessary  to  assume  an  exponential  failure 

A 

distribution  to  calculate  Rj  as  follows: 

Rj  - e'V  (Eq.  2) 

where  X Is  the  failure  rata  and  t Is  the  time  period  over  which  survival 

A 

Is  desired.  The  Rj  Is  the  probability  of  survival  of  the  J-th  component 
for  the  tine  period  t.  If  the  failure  history  (l.e.,  actual  tlmes-to- 
failure)  ware  recorded  In  addition  to  the  failure  rate  In  the  failure 
data  base,  a more  realistic  distribution  could  be  used  to  describe 
failures  of  the  component.  However,  the  exponential  Is  the  only  distri- 
bution which  can  accommodate  a constant  failure  rate  with  no  additional 
assumptions.  Therefore,  the  use  of  the  exponential  distribution  was 
dictated  by  the  type  of  failure  data  available. 

As  indicated  ebove,  the  complete  reliability  model  Is  simply  the 

A 

combination  of  the  g(R)'s  for  each  subsystem  and  the  Rj's  for  each 
component  In  that  subsystem.  The  HEL  system  reliability  estimate,  G(R), 
Is  the  product  of  the  appropriate  subsystem  g(R)'s,  since  the  subsystems 
are  serially  connected. 

C.  DATA  IASE  ASSEMBLY 

A general  search  of  hardware  reliability  data  banks  led  to  several 
sources  of  deta.  The  most  useful  appears  to  be  the  NRN  (Nonelectronic 
Reliability  Notebook),  which  resulted  from  efforts  funded  by  Rome  Air 
Development  Center,  and  the  CIDER  (Government  Industry  Data  Exchange 
Program)  failure  rate  data  bank.  In  addition,  some  data  have  been 
obtained  from  Hughes,  Rocket  dyne,  Garrett,  and  the  APVL's  APT  Failure 
Log.  These  sources  present  failure  rate  data  In  different  formats,  and 
much  of  the  date  analysis  affort  was  centared  on  screening  the  data  for 


applicability  and  on  applying  statistical  mathods  to  reduca  tha  various 
typas  of  data  to  a common  format  (l.e.,  failures  par  million  part* 
hours).  Tha  SOR  was  also  investigated  as  a possible  source  of  data, 
however,  the  SOR  records  would  not  allow  transformation  to  the  required 
format. 

A number  of  telephone  contacts  were  made  with  such  organizations  as 
ASO,  AFAL,  AFLC,  and  SPO's;  however,  no  useful  Information  or  data 
resulted  from  these  inquiries.  Other  sources  of  data  explored  were 
government  documents  and  open  literature.  These  were  examined  first  by 
scanning  the  NASA  Abstracts  as  far  back  as  1961.  A few  documents  of 
general  interest  in  reliability  and  cost  analysis  were  uncovered,  however 
none  of  them  had  any  significant  applicability  to  the  Laser  System 
Reliability  problem. 

In  addition,  a Work  Unit  Sumsary/Report  Bibliography  at  the  Secret 
level  covering  10  years  was  requested  from  DDC.  The  request  was  for 
reliability  data,  OR  failure  data,  OR  acceptance  test  data  for  each  item 

i 

of  a list  of .50  HEL  components.  Unfortunately,  reliability,  failure,  or 
acceptance  test  data  was  found  for  only  a few  of  the  Items;  however  none 
of  the  documents  contain  Information  useful  to  the  present  scope  of  the 
effort. 

The  data  base  assembled  for  the  HEL  system  Is  presented  In  appendix 
8.  Since  the  NRN  and  GIOEP  were  the  principal  sources  of  data,  the 
decision  was  made  to  represent  the  components  of  the  RBD  by  as  many  of 
the  NRN  or  GIOEP  parts  as  seemed  applicable  based  on  engineering  Judgment. 
This  approach  was  selectad  because  the  data  available  at  the  component 
level  was  very  sparse,  was  of  suspect  applicability,  and  did  not  begin 
to  adequately  reflect  the  complexity  of  each  component.  The  approach 
taken  puts  the  burden  of  the  ultimate  system  description  on  the  available 
data  base  rather  than  allowing  the  system  description  to  dictate  the 
data  requirements.  This  approach  generates  a much  more  realistic  and 
satisfying  model  application  In  the  short  run,  since  it  at  least  provides 
representative  values  of  reliability  for  analysis.  In  the  long  run, 
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however,  It  Is  much  more  beneficial  to  generate  the  successive  Increases 
In  model  detail  based  upon  engineering  considerations  rather  than  on 
data  availability  considerations.  The  major  advantages  of  the  engineer- 
ing approach  are:  (I)  It  points  out  data  deficiencies  so  that  test  data 

generation  can  be  directed  more  efficiently,  and  (2)  the  accuracy  of  the 
model  application  will  ultimately  be  greater. 

D.  FAILURE  CRITERIA 


The  definition  of  failure  It  Ideally  performed  Independently  of 
data  basa  constraints.  In  this  case,  however,  the  failure  criteria 
identification  required  a degree  of  definition  and  understanding  of  the 
physical  system  which  could  not  be  achieved  because  the  system  Is  not 
sufficiently  well  defined  to  al’iow  an  accurate  identification  of  the 
relationships  of  part  and  component  performance  parameters  to  HEL  system 
output  parameters.  For  example.  Ideally  one  would  determine  the  relation 
of  the  performance  characteristics  of  a turbo  pump  to  the  output  character- 
istics of  the  HEL  system.  Then  turbo  pump  failure  would  be  defined  as 
the  point  where  the  variation  of  turbo  pump  performance  caused  failure 
of  the  HEL  system.  Since  this  degree  of  analysis  was  precluded  by  the 
conceptual  nature  of  the  HEL  system,  we  were  forced  to  make  two  Important 
assumptions  concerning  failure  definition:  (1)  the  failure  criteria 

of  a part  ware  taken  to  be  those  assumed  by  the  failure  test  designer, 

(2)  the  failure  of  any  component  was  assumed  to  cause  failure  of  the 
subsystem  and,  consequently,  the  system. 

The  consequence  of  the  first  assumption  is  that  the  assembled  data 
base  defines  HEL  system  failure  Independent  of  engineering  considerations 
of  performance  effects.  An  alternative  approach  to  the  second  assumption 
might  be  to  Isolate  certain  components  whose  Individual  failure  would 
not  cause  system  failure  but  whose  cumulative  failure  would  ultimately 
cause  system  failure.  Then  one  could  construct  the  reliability  block 
diagram  such  that  a failure  of  any  three  of  six  components,  for.  example, 


would  produce  subsystem  failure.  This  approach  was  not  taken  because  It 
required  more  Insight  Into  the  engineering  and  performance  relationships 
among  the  components  than  was  immediately  available.  . 

In  summery,  than,  the  failure  criteria  are  as  follows.  A part 
falls  If  the  failure  data  base  Indicates  failure.  A component  falls  If 
any  part  fails.  A subsystem  falls  if  any  component  fails  (with  the  few 
exceptions  shown  In  the  reliability  block  dtagrams).  The  HEL  system 
fells  If  any  subsystem  falls. 

E.  HOOEL  APPLICATION 


The  failure  rate  data  In  appendix  B was  applied  to  the  reliability 
model  by  using  equation  2 to  generate  the  point  estimates  of  R.  to 
be  used  in  the  g(R)'s  end  the  G(R)'s.  Since  each  of  the  subsystems 
(e.g.,  GDL,  BCS,  and  FCS)  ere  in  series,  the  g(R)'s  in  that  HEL  system 
are  simply  multiplied  together  as  shown  in  equation  I.  The  component 
reliability  estimates  are  tabulated  in  table  2,  the  subsystem  and 
system  reliability  estimates  in  table  3 end  the  composites  for  the 
three  HEL  systems  are  plotted  In  figure  Ik. 

Table  3 shows  the  equivalent  HTBF's  assuming  the  systems  and 
subsystems  actually  experienced  the  pseudo* number  of  trials  and  successes 
calculated  according  to  the  reliability  synthesis  technique  and  assuming 
the  systems  end  subsystems  obey  an  exponential  failure  distribution. 
These  equivalent  NTBF's  are  presented  only  to  give  e feeling  for  the 
magnitude  of  the  reliabilities  and  are  not  a legitimate  product  of  the 
analysis. 

The  lower  95  percent  confidence  bounds  are  calculated  according  to 
techniques  developed  In  section  F of  this  chapter.  Since  the  confidence 
bounds  are  statistical  measures  of  the  confidence  in  the  reliability 
calculations,  they  should  not  be  Interpreted  as  Implying  anything  about 
the  confidence  In  the  HEL  system  Itself.  The  major  sources  of  the  wide 
variation  In  the  lower  confidence  bounds  are:  (1)  the  amount  of  failure 
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TABLE  2.  COMPOSITE  RELIABILITY  ESTIMATES  BY  SUBSYSTEM 


(page  I of  2) 

30  SEC  I HOUR 


GOL 


1 

0.9999670 

0.9960408 

2 

0.9999957 

0.9994894 

3 

0.9999946 

0.9993506 

4 

0.9999947 

0.9993677 

5 

0.9999994 

0.9999280 

6 

0.9999424 

0.9931033 

7 

0.9999977 

0.9997273 

8 

0.9999918 

0.9741471 

9 

0.9999991 

0.9998938 

10 

0.9999977 

0.9997235 

II 

0.9999801 

0.9976129 

CL 

38 

0.9999658 

0.9959030 

39 

0.9999670 

0.9960408 

40 

0.9999957 

0.9994893 

41 

0.9999987 

0.9998480 

42-45 

0.9999424 

0.9931033 

46 

0.9999977 

0.9997273 

47 

0.9997818 

0.9741471 

48 

49 

50 

0.9999991 

0.9998938 

0.9999946 

0.9993504 

51 

0.9999994 

0.9999280 

52 

0.9999956 

0.9994737 

53 

* -/999301 

0.9976129 

EOL 

54 

55 

56 

•*»  • ■ f •.  * 

0.9999977 

0.9997246 

57 

0.9999977 

0.9997246 

51 

0.9999843 

0.9981144 

59 

0.9997818 

0.9741471 

60 

0.9999987 

0.9998480 

61 

0.9999957 

0.9994894 

62 

0.9999670 

0.9960408 

6) 

0.9999983 

X v £ ^ 

0.9997912 
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TABLE  2.  COMPOSITE  RELIABILITY  ESTIMATES  BY  SUBSYSTEM 


(page  2 of  2) 


30  SEC 

1 HOUR 

6* 

0.9999979  ' 

0.9997516 

65 

0.9999967 

0.9993677 

66 

0.9999962 

0.9993086 

67 

0.9999977 

0.9997235 

68 

0.9999975 

0.9996970 

69 

0.9999801 

0.9976129 

BCS 


13 

It 

15 


16 

0.9999963 

0.9993163 

17 

0.9999966 

0.9995690 

18 

0.9999776 

0.9972970 

19 

0.9999889 

0.9986707 

20 

0.9999906 

0.9988676 

21 

22 

0.9998856 

0.9863596 

23 

26 

0.9999801 

0.9976129 

FCS 

Hal  rats 

0.9997860 

0.9766382 

Figure  14.  Plot  of  Reliability  Estimates  for  Three  HEL  Systems 


data  aval  labia  for  tha  parts  making  up  tha  systam,  and  (2)  tha  ral  la- 
bility constraints  involving  tha  number  of  Individual  nozzla  failures 
required  to  causa  failure  of  tha  entire  nozzla  bank. 

These  reliability  estimates  are  demonstrations  of  the  reliability 
prediction  methodology  and  should  not  be  used  as  engineering  measures  of 
HEL  system  effectiveness  for  two  reasons: 

(1)  Mission  success  or  effectiveness  relates  key  system  parameters, 
such  as  Intensity  on  target  and  Jitter,  back  to  the  operational 
characteristics  of  each  component.  Since  the  failure  data 
base  and  the  systam  description  preclude  such  a sophisticated 
analysis,  the  reliability  estimates  simply  describe  the  proba- 
blllty  of  succass  of  hardware  based  upon  a composite  of  many 
unknown  failure  criteria  of  the  failure  test  designers. 

(2)  The  accuracy  of  many  hardware  reliability  estimates  is  compro- 
mised by  the  incompleteness  and  the  wida  variation  in  the  appli- 
cability of  the  failure  data  base.  Thus,  the  actual  complexity 
of  many  of  the  components  is  not  adequately  reflected  by  com- 
ponent breakdowns  which  are  based  upon  available  data. 

F.  LOWER  CONFIDENCE  ROUNDS 

The  methodology  used  to  determine  confidence  bounds  on  the  HEL 
system  reliability  is  a modification  of  a recently  developed  analysis 
technique.5  The  technique  determines  a pseudo  number  of  trials,  n, 
and  successes,  x,  of  the  system  based  on  component  reliability  estimates. 
Then,  for  these  numbers,  a lower  confidence  bound  on  the  system  reli- 
ability is  determlnad.  The  relations  are: 


sEasterilhg,  R.  G.  "Approximate  Confidence  Limits  for  System  Reliability," 
Journal  of  the  American  Statistical  Association,  March  1972. 
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x-nG(R) 


.)  - G(R)  [l*G(R)]/n  (£q>  3) 


(Eq.  4) 


l(RL,  x,  n-x+1)  ■ I-y 


(Eq . 5) 


where  there  are  m components  in  th«  system,  G(R)  is  the  reilebility 
function,  R ■ (R,,  R,,  — , R ) , e hat  (*)  denotes  a point  estimate,  I 
is  the  incomplete  beta  distribution,  and  R^  is  the  approximate  lower 
confidence  bound  (100  y percent)  on  the  true  system  reliability. 

As  explained  earlier,  point  estimates  of  component  reliabilities 
were  obtained  from  the  exponential  distribution  due  to  failure  deta 
base  constraints.  Under  this  distribution  the  variance  of  ell  the 

A 

Rj 's  is  given  by 


Var^R^-  Rj  [,  nRjj  /nj 


(Eq.  6) 


where  nj  denotes  the  number  of  failures  of  the  J-th  component. 

From  this  relation  and  equation  3 above,  St  can  be  seen  that  the 
number  of  failures,  not  just  the  failure  rate,  is  required  for  all 
components  of  the  HEL  system.  However,  this  number  was  not  reported  for 
every  component.  In  those  cases  where  only  failure  rates  and  the  90  per* 
cent  confidence  bounds  were  reported,  the  following  relationship  was 
derived  and  utilised  to  determine  the  n: 
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(Eq.  7) 

where  denotes  the  upper  90  percent  confidence  bound  on  the  failure 
rate  X.  Thla  relation  Is  derived  In  appendix  C. 

The  FCS  Mas  handled  somewhat  dlffarently  sinca  failure  rate  and  confl- 
dance  bound  data  were  not  available.  Instead,  engineering  estimates 
were  used,  and  a value  of  n ■ I was  assumed  since  this  represented  the 
most  conservative  estimate  of  the  number  of  failures  which  could  be 
generated.  In  the  case  of  the  nozzle  component  of  the  GDI  and  CL  there 
were  no  observed  failures  and  only  18  failures  were  Identified  for  the 
EDL  nozzle/cavlty/dlffuser.  Relative  to  the  number  of  failures  Identi- 
fied for  most  of  the  other  components,  these  numbers  are  particularly 
small.  The  smell  amount  of  information  on  the  nozzle  Is  reflected 
analytically  by  a corresponding  large  variance  in  comparison  with  the 
other  components. 

Another  Important  factor  in  the  wide  variation  of  the  lower  confi- 
dence bounds  of  the  HEL  systems  Is  the  requirement  placed  on  the  respec- 
tive nozzle  systems.  In  the  case  of  the  CL  system,  at  least  95  percent 
of  only  188  nozzles  are  required  to  operate.  This  Implies  that  no  more 
than  9 nozzles  can  fail  and  the  subsystem  still  perform  adequately.  By 
comparison,  the  6DL  system  allows  no  mors  than  25  nozzle  failures  for  e 
similar  95  percent  restriction.  Data  upon  which  these  conclusions  are 
based  Is  given  In  appendix  0. 
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The  lower  95  percent  confidence  bounds  presented  in  table  3 were 
calculated  based  on  the  system  reliability  estimates  (for  t ■ 30  sec  and 
t ■ 1 hour)  end  equation  5*  These  lower  bounds  could  not  be  obtained 
directly  from  tables  of  the  incomplete  bate  function  so  an  approximation6 
was  utilized  as  follows: 


where 


u 


Z (h  ♦ X)l/2 

-H 


[1  ... 

. 1 .1 

+ 5 . 2 ' 

[2b  - 1 

2a  - 1J 

X F 3FT_ 

h * 2 [jrn-  * sW]  • x ■ (2y*  • 2)/6> 


a • x,  b ■ n - x ♦ 1,  and  2^  is  the  lower  confidence  bound  percentage 
point  (100  y)  of  the  normal  distribution  function. 

Calculations  that  producad  the  lower  bounds  are  given  In  appendix 
0.  Examination  of  these  calculations  Indicates  that,  for  an  initial 
short  period  of  continuous  operation,  the  FCS  and  BCS  control  the  estl- 
mate  of  system  reliability  for  all  three  HEL  systems.  For  a longer 
period  of  operation,  the  nozzle  configuration  and  the  requirements 
Imposed  on  It  become  the  largest  contributors  to  overall  system  reli- 
ability. It  should  be  noted  that  the  FCS  also  exerts  an  Influence  here, 
but  to  a much  smaller  extant  in  the  CL  and  EDL  systems. 


6 

"Handbook  of  Mathematical  Functions",  Milton  Abromowitz  and  Irene  A. 
Stegun,  National  Bureau  of  Standards,  AMS55,  1 964. 
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SECTION  IV 

_ RELIABILITY  OPTIMIZATION  METHODOLOGY 


A.  INTRODUCTION 


This  chapter  presents  the  analysts  of  costs  end  benefits  which  will 
be  used  to  determine  the  optimal  HEL  system  reliability  under  the  con- 
straints of  minimizing  costs  and  maximizing  benefits.  This  is  the  second 
major  part  of  the  LSR  methodology.  This  optimal  reliability  then  becomes 
the  goal  of  the  system  designers. 

The  costs  and  benefits  are  actually  composed  of  three  parts: 

(1)  LCC  (Life  Cycle  Cost)  which  is  a cost  element  coupled  with 
some  benefits  due  to  reduced  maintenance  requirements  with 
Increasing  reliability. 

(2)  Availability,  which  is  a benefit  that  allows  smaller  force 
requirements  as  reliability  increases. 

(3)  Combat  effectiveness,. a benefit  which  is  not  readily  mea- 
surable in  dollars  but  which  can  be  expressed  in  terms  of 
exchange  ratio  for  many  tactical  situations. 

The  LCC  and  the  availability  analyses  will  be  presented  together 
since  their  figure-of -merit  is  dollars.  This  will  be  followed  by  the 
combat  effectiveness  model. 

B.  ' LIFE  CYCLE  COST  ANO  AVAILABILITY 

I.  Introduction 

This  section  relates  the  LCC  of  a HEL  system  to  its  reli- 
ability. The  purpose  of  the  analysis  is  to  provide  the  capability  for 
assuring  the  lowest  LCC  of  the  HEL  system  in  terms  of  the  system  reli- 
ability. It  is  important  to  perform  this  kind  of  analysis  early  in  the 
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development  of  the  system  since  other  studies  heve  indicated  that  sig- 
nificant reductions  of  LCC  can  be  accomplished  by  expending  resources 
during  the  design  and  development  of  the  system.7 

The  analysis  used  here  decomposes  the  LCC  into  Its  three  principal 
components  and  then  performs  a parametric  analysis  to  determine  the 
relationship  between  reliability  (MTBF  for  an  exponential  distribution) 
end  LCC.  This  parametric  analysts  usas  historical  data  taken  from  simi- 
lar weapon  systems.  The  methodology  presented  In  this  analysis  is,  of 
course,  no  better  than  the  data  base  from  which  the  historical  failure 
rate  versus  LCC  data  is  drawn.  Since  Insufficient  resources  were  avail- 
able in  this  study  to  adequately  generate  the  appropriate  data  base, 
sample  data  will  be  presented  to  show  how  the  analysis  can  be  done  when 
the  methodology  Is  applied  to  a HEL  system. 

2.  Approach 

a.  Overview 

The  LCC  Is  decomposed  into  three  components:  IUD,  acqui- 
sition, and  OtS  (operating  and  support).  This  decomposition  is  per- 
formed so  that  a higher  degree  of  accuracy  can  be  Introduced  Into  the 
parametric  analysis  and  since  the  decomposition  will  aid  in  the  leter 
analysis. 

It  Is  necessary  here  to  define  each  of  these  three  com- 
ponents since  the  definitions  for  them  vary  depending  upon  the  user  and 
his  particular  needs.  For  the  HEL  system,  the  IUD  costs  are  those 
Incurred  before  the  prototype  weapon  system  Is  developed.  This  defini- 
tion is  necessary  since  the  HEL  Invokes  an  entirely  new  principal  for  a 
weapon  system  and  so  requires  a considerable  amount  of  A*D  effort  before 
the  weapon  system  can  even  be  defined.  Thus,  the  IUD  costs  would  Include 
all  of  the  ARTO  expenditures  at  least  through  SKAT.  The  second  element 


7"0ormant  Operating  and  Storage  Effects  on  Electronic  Equipment  and 
Fart  Reliability,"  Martin  Co.,  Orlando,  FL.,  RADC-TR-66-3W,  Contract 
AF30 (602) -3772*  October  1966. 
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of  th«  LCC  breakdown,  acquisition  costs,  Inctudas  tha  cost  of  designing 
and  developing  the  weapon  after  the  system  definition  has  been  completed. 
It  also  includes  the  cost  of  the  fabrication  of  the  hardware  Itself. 

The  OtS  costs  include  all  those  costs  required  to  operate  and  maintain 
the  system  for  a period  of  10  years.  When  these  three  cost  components 
are  added  together,  the  result  Is  the  total  LCC.  Experience  has  shown 
that  the  OtS  costs  dominate  the  other  two  components  (>  70  percent  of 
total  LCC),  and  so  particular  attention  must  be  maintained  for  the  0&S 
cost  in  generating  an  accurate  data  basa. 

Once  these  three  LCC  cost  curves  have  been  generated  from 
historical  data,  the  curves  are  differentiated  to  produce  marginal  cost 
curves.  Marginal  cost  Is  the  added  cost  of  one  more  Increment  In  rail* 
ability.  The  three  marginal  cost  curves  are  then  summed  to  produce  a 
composite  marginal  cost  curve  for  the  entire  LCC.  The  point  at  which 
this  composite  marginal  LCC  curve  Intersects  the  reliability  axis  Is  the 
optimum  reliability  for  the  system  In  terms  of  LCC. 

The  LCC  versus  reliability  analysis  Is  not,  however,  com* 
plate  without  consideration  of  another  factor.  In  addition  to  the  costs 
(both  positive  and  negative)  of  the  LCC,  certain  benefits  are  also 
derived  from  Increased  reliability.  Thus,  a benefit  analysis  must  be 
performed  to  address  the  benefits  for  an  entire  force  of  HEL  systems 
derived  from  Increasing  the  reliability  of  the  system.  The  total  HEL 
force  benefits  are  divided  Into  two  parts:  those  due  to  an  Increase  In 

the  availability  of  the  force  and  those  due  to  an  Increase  in  Its  combat 
effectiveness.  The  availability  benefit  Is  expressed  In  terms  of  dol- 
lars, however,  the  combat  effactlveness  is  expressed  In  terms  of  an 
exchange  ratio,  since  there  Is  no  accurate  way  of  translating  effec- 
tiveness Into  dollars.  A marginal  benefit  curve  due  to  availability  Is 
produced  which  Is  combined  with  the  composite  marginal  LCC  curve  to 
describe  the  net  marginal  cost / benefit  due  to  LCC  and  availability 
considerations. 
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b.  Parametric  Analysis  of  LCC 

In  this  subsection,  tha  LCC  Is  decomposed  into  three  com* 
ponents  and  representative  examples  of  the  shapes  of  these  curves  are 
presented.  Henceforth,  In  this  chapter,  MT8F  will  be  used  synonymously 
with  reliability  for  two  reasons:  (I)  all  costs  versus  reliability  data 

in  the  literature  are  referenced  to  MTBF,  and  (2)  the  two  are  equivalent 
if  the  exponential  distribution  assumption  is  made.  It  is  undesirable  to 
assume  the  exponential  failure  distribution,  however,  since  it  is  not 
representative  of  real  world  failures.  The  left  half  of  figure  15  presents 
an  example  of  the  cost  of  R&D,  acquisition,  and  O&S  versus  HTBF.  The  shapes 
of  the  first  two  curves  have  been  assumed  to  be  of  second  order  equations, 
since  both  R&O  and  acquisition  costs  increase  faster  as  each  of  the  systems 
being  developed  or  fabricated  approach  the  state  of  the  art  for  that  kind 
of  a system.  The  OtS  cost  is  also  second  order  due  to  the  economy  of 
scale  of  a larger  force,  but  that  economy  is  assumed  to  decrease  at  a 
constant  rate.  The  composite  LCC  (i.e.,  the  sum  of  R&D,  acquisition,  and 
0&S)  will  have  a minimum  cost  as  shown  in  figure  15*  It  is  important  to 
remember  two  things  in  Interpreting  the  total  LCC  curves: 

(1)  Each  curve  Is  for  a fixed  number  of  HEL  systems  (e.g.,  LCC 
could  be  normal Ixed  to  one  system). 

(2)  The  O&S  component  dominates  the  composite  curve. 

The  right  half  of  fffllire  15  shows  the  HC  (marginal  cost) 
curves  derived  by  differentiating  the  appropriate  total  LCC  curve  on  the 
left.  The  point  at  which  the  composite  HC  is  equal  to  zero  is  tl je 
optimal  HTBF. 

Tha  upper  half  of  figure  16  shows  tha  actual  LCC  ^s  a 
function  of  HTBF  for  recant  military  aircraft  systems,  and  was  derived 
from  data  presented  In  a symposium  addressing  design  to  cost  and  life  ' 
cycle  cost  considerations.9  It  is  important  to  remember  that  this  curve 
does  not  accurately  represent  the  actual  cost  of  a HEL  system,  however, 


•"Total  Ufa  Cycle  Costing,"  Proceedings  and  Related  Papers  of  the  Fall 
Technical  Symposium.  16-15  November,  19A,  American  Defense  Preparedness 
Association,  Washington,  D.C.,  Section  6,  Design  to  Cost  and  Life  Cycle 
Cost. 


!t  is  assumed  that  the  shape  of  the  curve  does  represent  the  shape  of 
the  curve  for  a HEL  system.  If  the  shape  is  representative,  one  can 
differentiate  the  curve  with  respect  to  MTBF  in  order  to  determine  an  MC 
curve.  The  optimum  MTBF,  then,  is  the  point  on  the  total  LCC  curve  at 
which  the  curve  crosses  the  MTBF  axis  (i.e.,  the  point  at  which  MC 
equals  0) . The  MTBF  at  MC  equals  0 is  the  point  at  which  total  LCC  is 
minimized  since  any  MTBF  to  the  right  of  this  point  will  incur  addi- 
tional cost  (positive  MC),  while  any  MTBF  to  the  left  of  this  point  will 
incur  additional  savings  (negative  MC). 

Figure  16  is  an  example  of  the  kind  of  data  which  has 
been  uncovered  in  the  literature  search  which  has  been  conducted. 

t t 

In  this  case,  the  available  data  were  not  broken  down  into  the  three 
components  discussed  above,  but  were  in  the  form  of  composite  LCC.  If 
the  data  could  be  found  for  the  three  components  and  summed,  that  method 
would  be  superior  to  the  kind  of  data  in  figure  16  for  two  reasons: 

(1)  The  data  summarv  leaves  no  room  for  analysis  to  determine 
where  the  costs  breaks  specifically  exist  or  to  investigate 
the  reasonableness  of  the  conclusions. 

(2)  The  data  summary  does  not  define  exactly  what  costs  are 
included  in  the  LCC. 

If  the  decomposed  data  cannot  be  found  when  the  reliability  optimization 
methodology  is  applied  in  the  future  as  desired,  then  composite  data  of 
the  kind  displayed  in  figure  16  will  have  to  be  used.  If  that  situation 
exists,  the  subsequent  analysis  will  remain  unchanged.  Only  the  credi- 
bility of  the  conclusions  and  the  depth  of  the  analysis  will  suffer, 
c.  Marginal  Benefit  From  Availability 

The  analysis  so  far  has  considered  only  the  costs  from 
the  three  components  of  LCC.  Although  some  of  these  costs  are  negative 
(i.e.,  benefits  as  indicated  by  the  06S  cost  curve  in  figure  15),  the 
total  benefits  of  the  reliability  program  have  not  yet  been  considered. 

In  order  to  identify  the  overall  benefits  of  increasing  MTBF,  one  must 
consider  the  benefits  of  an  entire  force  of  HEL's,  rather  than  merely 


analyzing  the  cost  of  one  HEL  system.  This  section  addresses  those 
benefits  derived  from  the  availability.  Combat  effectiveness  benefits 
are  treated  in  a later  section  of  this  chapter. 

Since  an  increased  MTBF  increases  the  availability  of  a 
force,  fewer  numbers  of  HEL  systems  are  required  to  perform  the  same 
function  than  at  a lower  HTBF.  This  decrease  in  the  force  size  can  be 
expressed  as  a savings  of  dollars.  For  example,  if  there  is  a require* 
ment  for  100  available  HEL  systems,  increasing  the  availability  of  the 
force  from  0.9  to  0.91  will  result  In  the  savings  of  one  HEL  system. 

The  change  in  availability  of  a force  due  to  a change 
In  reliability  can  be  calculated  by  using  one  of  a number  of  existing 
models.  One  such  model  is  called  ARIES  (Aggregate  Recoverable  Item 
Evaluation  System)  which  calculates  the  cost  of  unscheduled  maintenance 
in  the  life  cycle  of  a weapon  system.  ARIES,  or  some  similar  model, 
can  be  used  to  quantify  the  resultant  change  In  availability  due  to  a 
given  increase  in  the  reliability  of  the  HEL  system.  The  ARIES  model 
computes  the  10-year  LCC  for  unscheduled  maintenance  for  the  aggregate 
of  all  the  recoverable  Items  in  the  system  as  the  system  Is  deployed 
throughout  a multiechelon,  base-depot,  maintenance  concept  configuration. 

The  marginal  benefit  would  be  derived  from  the  ARIES 
model  as  follows.  ARIES  would  calculate  force  availability  as  a func- 
tion of  HEL  system  reliability.  Once  the  availability  is  known,  the 
force  size,  and  thus  its  cost,  would  be  calculated,  again  as  a function 
of  reliability.  Finally,  the  cost  function  would  be  differentiated  with 
respect  to  reliability  to  generate  the  marginal  benefit. 

To  Illustrate  the  technique*  a simplified  model  has  been 
used,  and  each  of  the  three  steps  to  find  the  marginal  benefit  relation 
has  been  demonstrated.  First,  let  us  assume  that  availability  Is  related 
to  MTBF  as 


MTBF 

* * Hfirrsmt 


(Eq.  8) 


where  MTTR  ■ mean  time  to  repair.  This  relation  Is  shown  in  figure  17. 
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Figure  17.  Availability  Versus  MTBF 
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Assume  now  that  the  cost  is  simply  that  due  to  the  acqui 
sition  of  a sufficient  number  of  weapon  systems  to  keep  the  available 
force  fixed  at  F,  i.e., 

N » F/A  (Eq.  9) 


where  N is  the  number  of  HEL  systems  required  at  a given  MT3F  according 
to  equation  o.  Combining  equations  8 and  9 yields 


_ MT8F  + MTTR 
MTBF 


(Eq.  10) 


If  N is  directly  proportional  to  force  cost  and  F is  set 
to  unity  to  normalize  the  relation,  equation  10  can  be  plotted  as  shown 
in  figure  18. 

The  marginal  cost  can  be  found  by  differentiating  equa- 
tion ! 0 with  respect  to  MTBF  to  get  (with  F = 1) 


or 


mc  « - fins, 

MTBF2 
MB  ■ - MC 

- MTTR 

MTBF2 


(Eq.  II) 


Equation  II  is  plotted  in  figure  19. 

The  marginal  benefit  curve  of  figure  19  is  of  the  proper  form 
(except  for  denormal i zing  to  get  absolute  dollars)  to  combine  with  the 
composite  marginal  cost  of  figure  15  to  yield  NMC  (Net  Marginal  Cost): 

NMC  - CMC  - MB  (Eq.  12) 

where  CMC  * composite  marginal  cost  from  the  LCC  analysis,  and  MB  “ 
marginal  benefit  from  the  availability  analysis.  When  NMC  * 0,  the 
optimal  system  MTBF  has  been  achieved  (with  the  exception  of  combat 
effectiveness  considerations). 
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Figure  18.  Relative  Cost  of  HEL  Force  Figure  19.  Marginal  Benefit  from 
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Needless  to  say,  this  antlra  procedure  can  ba  parformed 
eithar  analytically  or  graphically  or  In  a mixed  mode  depending  upon  the 
format  and  quality  of  the  data  and  upon  the  analyst's  preference, 
d.  Discounted  Cash  Flow 

One  additional  factor  needs  to  be  considered  here.  Any 
time  a flow  of  money  over  a long  period  of  time  is  considered,  one 
encounters  the  problem  of  comparing  prasent  dollars  with  future  dollars. 
In  this  analysis,  we  are  trading  off  costs  expended  initially  (or  at 
least  early  In  the  life  cycle)  with  savings  or  benefits  to  be  realized 
at  some  future  date.  This  time -value -of -money  problem  becomes  even  more 
acute  during  Inflationary  periods  such  as  the  present.  To  solve  this 
problem,  a complete  analysis  would  discount  the  future  flow  of  costs  and 
benefits  back  to  the  present.  Instead  of  merely  summing  the  costs  and 
benefits  of  mixed  value,  a present  value  of  each  flow  component  would  be 
calculated  using  an  appropriate  discount  rate  or  series  of  rates.  This 
Is  a very  straightforward  exercise  using  the  discounted  cash  flow 
technique. 

The  technique  Is  demonstrated  by  Equation  13. 


PV  ■ 


I 


T 


(i  ♦ 0 


2 '’n 

♦ i <••••♦  ■ —■■■  . 

(1  ♦ I)2  (I  ♦ I)" 


(Eq.  13) 


where 

PV  • present  value  of  cash  flow 
Cn  ■ cash  flow  (net  cost)  In  year  n 

I • discount  rate 


The  technique  can  be  generalized  to  accommodate  a varying  discount  rate 
from  year  to  year. 

Cl  C2 

w ' (I  ♦ I,)  * (I  ♦ I, J(l  ♦ l2) 

(Eq.  tk) 

cn 

*•••*  irv  r)T(rv,i'),:,::(i,7TnT 
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To  illustrate  th«  Importance  of  the  time  value  of  money, 
the  present  value  of  a flow  of  $t/year  for  10  years  discounted  at  a 10 
percent  rate  Is  $6.14.  The  present  value  of  a $1  payment  In  year  10  Is 
$0.39*  Thus,  If  a comparison  of  costs  and  benefits  over  a 10  year  per- 
iod is  to  be  made,  It  Is  very  Important  to  express  the  resulting  flows 
in  terms  of  a common  value  of  a dollar. 

The  only  problem  with  this  method  is  that  of  arriving  at 
an  appropriate  discount  rata.  The  discount  rate  must  include  considera- 
tion of  both  the  Inflation  factor  and  cost -of -capita  I factor  for  the 
00D.  The  Inflation  factor  Is  easily  obtained  by  using  the  Price  Esca- 
lator Indices  from  the  Comptroller,  Assistant  Secretary  of  Defense.  The 
same  office  could  probably  also  contribute  a value  for  the  cost-of- 
capital  factor.  In  any  event,  a period  as  long  as  10  years  can  cause 
seriously  erroneous  conclusions  If  the  time  value  of  the  funds  flow  Is 
ignored. 

C.  COMSAT  EFFECTIVENESS 

This  section  provides  an  algorithm  for  first  order  estimates  of  the 
effects  of  HEL  reliability  on  HEL  airborne  combat  effectiveness.  A dis- 
cussion Is  also  presented  on  the  Impact  of  laser  reliability.  The 
model  Is  then  used  to  generate  the  exchange  ratio  versus  reliability 
data  which  becomes  an  input  to  the  cost/benefit  analysis  to  optimize 
reliability.  This  model  uses  exchange  ratio  as  the  M0E  (measure  of 
effectiveness).  No  single  M0E  can  be  used  for  all  possible  missions,  so 
the  EA  was  chosen  as  an  example. 

!•  Combat  Effectiveness  Aloorlthm 

The  algorithm  presented  here  enables  first  order  estimates  of 
laser  reliability  on  outcomes  of  aerial  combat  between  a laser  armed 
aircraft  and  an  attacking  aircraft  employing  any  feasible  number  of 
AAM's  or  gun  firing  attempts.  Enemy  SAM  attacks  on  the  laser  armed 


(1) 


aircraft  ara  also  accommodated,  as  wall  as  an>  reasonable  number  of 
successive  encounters.  Friendly  and  enemy  aircraft  kill  probabilities 
are  directly  computed,  enabling  dtrect  determination  of  values  of  such 
MOE's  as  the  ER. 

We  start  with  the  following  definitions  of  terms: 

Defens Ive* hassle  « an  encounter  between  a laser  armed  aircraft 
and  any  feasible  number  of  successive  attacking  SAN's  or 
AAH's,  or  gun  firing  passes.  A defensive  hassle  terminates 
prior  to  the  next  offensive  laser  shot  (e.g.,  a laser  shot  at 
the  enemy  aircraft). 

Offensive  hassle  ■ one  or  more  laser  shots  at  the  enemy  air- 
craft. The  offensive  hassle  terminates  prior  to  the  next 
defensive  hassle. 

Figure  20  presents  the  generic  probability  tree  diagram  for 
the  kill  calculations  algorithm.  Note  that  the  order  or  number  of 
offensive  and  defensive  hassles  is  arbitrary,  since  we  may  set  certain 
input  parameters  to  values  such  that  nonoccurring  hassles  indicated  on 
figure  20  are  accounted  for,  retaining  algorithm  validity. 

Let 


(2) 


Rj  • laser  reliability9  for  the  Ith  laser  firing, 

P|  • probability  that  the  laser  kills  the  threat,  on  i 
laser  firing 


th 


I 


1-P 


For  the  Jth  offensive  hassle  (sea  figure  20),  we  define: 

0j  • probability  that  laser  does  not  kill  the  enemy  aircraft, 
and  laser  Is  operable  at  end  of  Jth  offensive  hassle 
(given  surviving  and  operable  laser  and  laser  armed 
aircraft  at  start  of  Jth  offensive  hassle); 


9 The  Ith  firing  Is  of  time  duration  tJ(  and  Rj  Is  determined  from 
expressions  for  6(R)  described  in  chapter  III. 


Figure  20.  Generic  Probability  Tree  OiagraM  for  Kill  Calculations 


and 


and 


Fj  ■ probability  that  laser  doas  not  kilt  the  enamy  aircraft, 
and  lasar  is  I noparable  (failed)  at  and  of  offensive 
hassle  (given  surviving  and  operable  laser  and  laser 
armed  aircraft  at  start  of  Jt^  offensive  hassle); 

Ej  » probability  that  lasar  kills  the  enemy  aircraft  (given 
surviving  arid  operable  laser  and  laser  armed  aircraft 
at  start  of  the  J**1  offensive  hassle); 


9j  ’ *jtj 

fj.Tj 


EJ  * Vj 


0j  ♦ Fj  ♦ Ej  ■ 1.0,  as  required. 


Note  that  If  the  first  hassle,  for  example,  Is  a defensive  hassle, 
we  set  » 1.0,  Fj  ■ E|  ■ 0.0. 


The  model  calculates  ER  as  a function  of  the  parameters  pre- 
sented in  figure  20  which  use  reliability  as  the  starting  point.  The 
details  of  the  derivation  of  the  model  are  presented  In  appendix  E. 

2-  »«Pbct  of  Reliability  on  HCL  Combat  Effectiveness 

The  algorithm  developed  In  appendix  E and  the  worked  examples 
of  appendix  F Indicate  the  potential  for  significant  Impact  of  HEL  reli- 
ability on  HEL  combat  performance.  In  any  scenario  Involving  several 
laser  firings  for  survival  against  attacking  threats,  HEL  reliability 
less  than  1.0  can  significantly  detract  from  the  advantage  of  laser 
SSFK's  close  to  t.O  In  values. 

Table  i)  shows  how  ER  varies  with  reliability  from  the  exam- 
ples In  appendix  F with  the  following  constraints. 

«*•-<£)  So  !<•«?  .•?  * ..  -.O  ••  si,  <r« 
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(1)  Laser  SSPK's  much  superior  to  (graatar  than)  attacker's  AAM 
SSPK's. 

(2)  A maximum  of  only  five  laser  firings. 


TABLE  4.  RELIABILITY  EFFECTS  ON  COMBAT  EFFECTIVENESS 


HEL  RELIABILITY 

HASSLE  2 

HASSLE  3 

HASSLE  A 

EXAMPLE 

PROBLEM 

«1  «2 

"j 

*1  *2 

EXCHANGE 
RATIO  (ER) 

2 

t.O  1.0 

1.0 

1.0  1.0 

84.3 

1 

0.9C  0.93 

0.90 

0.92  0.92 

7.0 

One  Implication,  among  several  that  will  be  discussed  below, 
is  that  payoff  (higher  ER)  might  be  obtained,  for  example,  by  an  increase 
in  the  maneuverability  of  laser  armed  aircraft  maneuverability  increase 
which  could  enable  laser  first  shot(s),  by  altering  the  hassle  sequence, 
provided  laser  SSPK's  did  not  thereby  suffer  excessive  degradation. 

Since  the  effect  of  laser  reliability  less  then  1.0  Is  cumula- 
tlve  with  each  successive  defensive  firing  requirement,  there  Is  a dis- 
tinct payoff  for  retention  of  sufficient  laser  armed  aircraft  maneu- 
verability, radar/ECM  performance,  etc.,  so  that  the  laser  armed  air- 
craft may  have  Increased  chance  of  first  shot(s)  against  an  enemy 
aircraft. 

The  specific  degree  of  the  above  mentioned  payoff  would  depend 
upon  the  specific  values  of  hassle  Input  parameters.  However,  It  Is  not 
difficult  to  envision  the  advantage  of  laser  first  shot(s)  attainment. 
Referring  to  the  appendix  F examples,  with  all  Individual  hassle  input 
parameters  held  constant.  Increased  payoff  (higher  ER  values)  Is  real- 
ized as  one  progresses  In  order  from  first  to  last  of  the  following 
Improvements. 


0)  Shift  of  hassle  sequence  to  offensive,  defensive,  defensive. 

(2)  Shift  of  hassle  sequence  and  avoidance  of  2nd  defensive 
hassle,  resulting  In  an  offensive,  defensive  sequence. 

(3)  Change  of  hassle  sequence  to  one  offensive  hassle  only. 

(k)  Change  of  hassle  sequence  to  several  offensive  hassles  prior 
to  any  defensive  hassle. 

The  above  Improvements  might  be  attained  by  such  means  as 
increase  in  laser  armed  aircraft  speed,  maneuverability,  and  detection 
and/or  acquisition  capabilities.10  Specific  payoff  (increased  ER)  mag- 
nitude would  of  course  depend  upon  specific  input  parameter  values, 
Including  laser  firing  times  and  associated  reliabilities. 

0.  SUMMARY  OF  OPTIMIZATION  RELIABILITY  METHODOLOGY 

The  three  considerations  which  provide  the  inputs  to  the  reli- 
ability optimization  methodology  are  life  cycle  cost,  availability,  and 
combat  effectiveness.  The  LCC  and  availability  costs  and  benefits  were 
expressed  In  terms  of  dollers  as  functions  of  reliability.  Then  these 
relations  were  differentiated  to  yteld  marginal  costs  and  marginal  bene- 
fits. The  combet  effectiveness  model  was  developed  to  express  exchange 
ratio  as  a function  of  reliability.  Finally,  the  net  marginal  cost  from 
LCC  and  availability  are  combined  with  the  ER  benefit  to  provide  the 
Inputs  for  making  the  optimal  reliability  decision.  This  final  combina- 
tion is  necessarily  a qualitative  one  relying  on  engineering  judgment 
since  the  combat  effectiveness  benefit  is  not  expressed  in  dollars  as 
the  other  costs  end  benefits  are.  This  entire  methodology  is  Illus- 
trated In  figure  21. 
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Reliability  Optimization  Methodology 


SECTION  V 

RELIABILITY  APPORTIONMENT  METHODOLOGY 


A.  INTRODUCTION 


This  chapter  disc  ribas  the  third  part  of  the  LSR  methodology  which 
Is  designed  to  apportion  the  rellabtlty  goal  among  the  subsystems  and 
components.  The  first  section  discusses  the  available  methods  for 
improving  the  system  reliability  (engineering  design  guidelines)  since 
this  is  the  responsibility  of  the  system  designer.  The  next  sections 
present  the  analytical  procedures  for  allocating  the  reliability  improve- 
ments among  the  subsystems  and  components. 

B.  DESIGN  GUIDELINES 


System  reliability  can  be  upgraded  by  the  application  of  six  techni- 
ques: (1)  redundancy,  (2)  Increase  In  Inherent  reliability,  (3)  quality 
assurance,  (k)  bum-ln  testing,  (5)  maintenance  procedures,  and  (6) 
built  In  test  equipment. 

Redundancy  can  be  included  In  several  ways,  at  both  the  component 
and  the  part  level.  Both  hardware  redundancy  and  functional  redundancy 
are  possible.  There  are  three  types  of  hardware  redundancy. 

(I)  Non-decision  redundancy  (active)  Is  most  commonly  characterized 
by  two  parallel  (often  Identical)  components  which  always 
operate  simultaneously  to  increase  the  success  probability  of 
the  function  which  they  perform.  Non-decisfon  redundancy  Is 
usually  easiest  to  Incorporate  Into  a system  and  Introduces 
minimal  complexity,  but  has  several  disadvantages. 

(a)  Increases  the  weight  and  volume  of  the  system. 

(b)  Does  not  increase  the  lifetime  of  the  components. 

(e)  All  components  ere  active  and  consume  power. 


(2)  Decision  redundancy  without  switching  (active)  is  upea  pri- 
marily in  digital  appl Icatlons,  to  assure  that e/rors  In 
decision  logic  are  minimized.  As  with  nondedlsion  redundancy, 
component  lifetime  is  not  Increased;  aQd'all  components  are 
active  and  consume  power. 

(3)  Decision  redundancy  with  switching  is  usually  characterized  by 
the  use  of  "stand-by"  components  and  sensors  or  command  links 
to  provide  switching  when  one  component  fails.  Weight  and 
volume  penalties  must  be  paid;  but.  with  this  type  of  redundancy, 
hardware  life  may  be  extended  since  only  one  component  is 
active  at  a time  (reducing  power  consumption.) 

The  Inherent  reliability  can  be  Increased  by  derating  the  parts,  by 
using  conservative  design  procedures,  and  by  tightening  the  specifica- 
tions on  each  part. 

A quality  assurance  program  can  be  established  to  upgrade  the 
quality  of  parts  during  manufacture  (l.e.,  to  prevent  the  delivery  of 
parts  which  do  not  meet  specifications). 

Bum-In  testing  and  weeding  out  the  failed  parts  before  essembly  is 
an  effective  way  of  significantly  reducing  the  high  'failure  rate  early 
in  the  life  of  a system.  A RADC  study  has  Indicated  that  burn-in  testing 
can  decrease  early  failure  rate  by  a factor  of  seven  for  electronic 
components. 11 

Specific  maintenance  procedures  can  be  Implemented,  such  as  the 
removal  of  limited-life  parts  on  a routine  schedule  or  the  use  of  a very 
conservative  maintenance  schedule. 

Built-In  test  equipment  can  be  used  to  Improve  fault  detection  and 
fault  isolation. 

C.  SUBSYSTEM  CRITICALITY  BANKING 

in  this  section,  a quantitative  methodology  is  presented  for  ranking 
subsystems  In  terms  of  the  criticality  of  thosa  subsystems  to  the  overall 

11  Dormant  Operating  and  Storage  Effects  on  Electronic  Equipment  and  Part  Relia- 
bility," Martin  Co.,  Orlando,  PL.,  RADC-TR-66-3W,  Contract  AF  30(602) -3772 , 
October  1966. 
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functioning  of  the  HEL  system.  The  objective  of  the  criticality  ranking 
methodology  Is  to  quantify  the  importance  of  a particular  subsystem  to 
the  HEL  system  by  examining  the  effects  of  ail  possible  failure  modes  of 
the  subsystems.  The  first  step  In  this  criticality  ranking  methodology 
is  to  perform  a FHEA  (Failure  Mode  and  Effects  Analysis).  The  second 
step  Is  to  perform  a CA  (Critical  Analysis). 

1.  Failure  Mode  and  Effects  Analysis 

The  purpose  of  the  FMEA  is  to  Identify  the  failure  modes 
associated  with  each  subsystem  end  to  analyze  the  effects  of  such  a 
failure  on  the  component  which  has  failed,  on  the  next  higher  level 
function,  and  finally  on  the  HEL  system.  The  FHEA  procedure  is  a 
modification  of  that  presented  by  the  Society  of  Automotive  Engineers.12 

The  FMEA  procedure  is  as  follows: 

(1)  Hake  a concise  statement  of  the  function  performed 

(2)  Consider  at  least  the  four  typical  failure  modes: 

(a)  Premature  operation 

(b)  Failure  to  operate  at  a prescribed  time 

(c)  Failure  to  cease  operations  at  a prescribed  time 

(d)  Failure  during  operation 

(3)  Define  the  mode  of  operation  in  which  the  failure  occurs  (e.g. 
threat  detection,  threat  acquisition,  threat  tracking,  firing, 
or  kill  assessment) . 

(4)  Make  a brief  statiment  describing  the  ultimate  effect  of  the 
failure  on  the  component  being  analyzed. 

(5)  Make  a brief  description  of  the  effect  of  the  failure  on  the 
next  higher  level  of  the  functional  block  diagram. 

(6)  Describe  the  effect  of  the  component  failure  on  the  HEL 
system. 


"Design  Analysis  Procedure  for  Failure  Mode,  Effects  and  Criticality 
Analysts,"  Society  of  Automotive  Engineers,  Aerospace  Recommended 
Practice,  ARP  926,  September  1967. 
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(7)  Define  a ■ fraction  of  failures  in  that  failure  mode. 

(8)  define  6 ■ conditional  probability  that  described  effect 
actual 1y  occurs. 

(9)  Define  y ■ failure  effect  consequence 

0 * no  effect 

1 - mfnor  degradation 

2 - moderate  degradation 

3 ■ serious  degradation 

4 - total  loss 

5 * catastrophic  falluret  possible  loss  of  life. 

These  nine  factors,  when  taken  together,  define  the  failure  mode 
and  the  effects  of  that  failure  mode  on  each  of  the  subsystems  under 
investigation.  These  factors  can  be  summarized  In  e table,  and  as  an 
example  table  5 Is  presented  for  the  parts  of  a GDL  cryogenic  storage 
component. 

2.  Procedure  for  Criticality  Analysis 

The  criticality  number,  C,  for  the  component  under  Investigation 
can  be  calculated  according  to  the  following  expression: 

J 

C - V a 8 y 
iJ  n n Tn 

n*l 

where  J ■ total  number  of  failure  modes  of  that  component;  and  a,  8, 
end  y ere  as  they  were  defined  above. 

This  criticality  number  does  not  include  any  of  the  rel lability 
factors  normally  Included  In  the  calculation  of  a criticality  number. 

This  has  been  done  because  these  reliability  effacts  have  already  been 
Included  tn  the  reliability  model  and  the  subsequent  point  estimates  of 
reliability.  The  criticality  number  defined  above  addresses  only  those 
factors  which  are  directly  affected  by  the  failure  mode  or  the  effects 
of  that  failure  mode  on  the  HEl  system.  Thus,  the  criticality  number 
addresses 'only  criticality  factors,  while  the  rat  lability  number  addresses 


TABLE  5.  FAILURE  MOOE  AND  EFFECTS  ANALYSIS 


only  reliability  factors,  so  thara  Is  no  chanca  of  doubla  counting  of 
reliability  considerations. 

An  example  of  the  criticality  number  calculation  for  the  table 
5 data  is  as  follows: 

C ■ (0.15  x 0.)  x I)  ♦ (0.15  x 0.1  x I)  +...♦  (0.05  x 1.0  x k) 

- 0.56  . 

0.  RELIABILITY  APPORTIONMENT 

1.  General  Methodology 

Once  the  engineering  methods  for  reliability  Improvement  are 
understood  as  they  can  be  applied  to  the  HEL  system,  and  the  subsystem 
criticalities  have  been  calculated  and  ranked,  the  apportionment  or 
budgeting  of  the  reliability  upgrade  must  be  determined.  The  method- 
ology for  this  function  follows,  and  Is  a modification  of,  that  pre- 
sented In  Lloyd  and  lipow.13 

First  the  reliability  of  the  system  before  reliability  upgrade 
Is  calculated  and  compared  to  the  reliability  required  for  optimizing 
Life  Cycle  Cost,  Availability,  and  Combat  Effectiveness.  If  the  required 
reliability  Is  larger  than  the  expected  reliability,  then  a new  reliability 
Is  calculated  for  each  subsystem  which  would  produce  the  required  system 
reliability  (l.e.,  assume  that  the  total  change  In  system  reliability  Is 
to  be  accomplished  by  a change  In  the  reliability  of  one  of  Its  subsystems). 
If  this  Is  done  for  each  subsystem,  then  the  subsystems  can  be  ranked 
according  to  their  reliability  increases  needed  to  achieve  the  system 

x - 

reliability  goal.  One  can  carry  this  further  by  attributing  the  reliability 
upgrade  to  two  or  more  of  the  subsystems  which  is  a far  more  realistic, 
but  more  complicated,  approach  to  the  problem. 

2.  Single  Parameter  Apportionment 

To  Illustrate  the  reliability  apportionment  technique,  let  us 
assume  that  a reliability  goal  has  been  established  for  the  G0L  subsystem, 
and  Che  objective  Is  to  budget  that  goal  among  the  components  of  the  G0L 
subsystem.  The  variables  are  defined  as  follows: 

13"Retlablllty:  Management,  Methods,  and  Mathematics,"  David  K,  Lloyd  and 
Myron  Lipow,  Prentice-Hall,  1962,  Appendix  9A. 


62 


R ■ subsystem  reliabiltty  before  upgrade 

r’  - subsystem  reliability  goal 

r ■ reliability  of  n-th  component  before  upgrade 

r'  ■ reliability  of  n-th  component  after  upgrade 

n 

Assume  that  the  components  are  all  serially  connected  for  simplicity  in 

the  Illustration  (l.‘e.t  R ■ r.  x r,  x...x  r ).  Now  the  r,f,  rl , ....  r* 

\ 2 n 12  n 

can  each  be  calculated  assuming  that  each  of  them  is  sufficient  to 
generate  the  required  R.' 

, R* 

rl  " % x r,  x. . .x  r P1 

2 j n 

, ^ K9 

r2  r.  x r,  x...x  r r2 

i n 


r'  ■ ..  ♦a  r 

n r,  x r2  x...x  r j n 


If  the  cost  of  each  of  the  Ar's  can  be  sattsfactorally  determined, 
then  the  choice  of  which  component  or  components  should  benefit  from  a 
reliability  upgrade  program  can  be  based  upon  such  a ranking.  However, 
It  is  more  likely  that  the  cost  estimates  will  be  very  Imprecise  since 
the  Life  Cycle  Cost  analysts  cannot  begin  to  dtfferantlate  among  costs 
at  this  level  of  detail.  In  this  situation,  the  components  may~be- — 
ranked  In  order  of  decreasing  Ar,  and  engineering  Judgment  may  then  be 
used,  for  example,  one  may  assume  that  the  cost  per  Ar  (l.e.,  the 
marginal  cost)  for  each  component  Is  the  same;  thus  the  Ar  ranking  Is 
also  the  ranking  of  cost  of  Implementation. 
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An  additional  piaca  of  data  to  ba  considarad  In  tha  rail* 
ability  apportionmant  Is  tha  criticality  number,  C,  darlvad  In  tha 
previous  section.  As  long  as  tha  procedure  for  criticality  ranking  of 
each  subsystem  Is  Identical,  tha  Internal  consistency  of  tha  C's  Is 
maintained.  It  Is  quite  difficult,  however,  to  attempt  to  quantitatively 
link  a Cn  to  a ArR  since  tha  relative  weighting  of  tha  two  quantities  Is 
unknown.  A much  better  use  of  the  C ranking  is  to  merely  put  the 
criticality  ranking  next  to  the  Ar  ranking  and  then  make  a qualitative 
englneerlng/menagement  Judgement  about  the  relative  importance  of  the 
two  scales  and  how  they  should  Impact  the  apportionment  decision. 

The  important  point  Is  to  use  the  criticality  ranking  and  the 
reliability  ranking  with  other  available  engineering  and/or  management 
considerations  to  make  the  best  apportionment  decision  possible. 

3.  Hultl  Parameter  Apportionment 

If  engineering  considerations  Indicate  that  the  required  R'may 
be  difficult  or  undesireable  to  achieve  by  means  of  a single  component 
upgrade,  then  the  component  with  the  next  higher  Ar  Is  also  considered, 
and  some  combination  of  the  two  component  Ar's  is  necessary.  This 
expansion  to  Increasing  numbers  of  components  can  be  carried  as  far  as 
desired,  however  the  complexity  of  the  problem  increases  with  the  num- 
ber of  possible  combinations  of  Ar.  This  solution  can  be  symbolically 
written  as: 


r;  x rl 


A' 


r3  x rk 


• x r 


e»Ar,  x Ar. 


r;  x rl 


rk  x r.  x...x  r 


•■Arj  x Ar2 


x Ar, 


6* 


Thus,  as  can  ba  saen  from  the  second  equation,  any  possible  combination 
of  &rj,  Ar^,  ...  which  satisfies  the  equation,  is  a possible  target  for 
the  reliability  upgrade  process. 

In  the  case  of  the  apportionment  to  two  or  more  components, 
the  required  component  reliability  changes  are  not  uniquely  defined 
since  there  are,  in  general,  an  infinite  number  of  combinations  of 
component  reliabilities  which  can  achieve  the  subsytem  reliabllty  goal. 
This  Is  an  optimization  problem  and  can  be  solved  by  the  use  of  linear 
programming  techniques.  Such  factors  as  criticality  number,  costs, 
time,  weight,  and  volume  can  be  used  as  constraints  in  the  linear  pro- 
gramming problem. 

E.  SUMMARY  OF  RELIABILITY  APPORTIONMENT  METHODOLOGY 


The  reliabllty  apportionment  methodology  can  be  summarized  as 
follows.  First,  evaluate  the  design  guidelines  (l.e.,  the  engineering 
techniques)  which  are  available  to  the  system  designer  and  applicable  to 
the  HEL  system.  Second,  perform  a failure  modes  and  effects  and  criti- 
cality analysis  to  construct  a ranking  of  the  components  according  to 
their  criticality  to  the  HEL  system  If  component  failure  occurs.  Finally, 
the  criticality  ranking  can  be  combined  with  either  the  single  or  multiple 
parameter  apportionment  analysis;  and  the  results  can  be  used  In  conjunc- 
tion with  engtneering/management  considerations  to  allocate  the  reliability 
goal  among  the  subsystems  and  components.  Keep  In  mind  that  the  techniques 
described  In  this  chapter  should  be  used  to  provide  an  order  to  the 
various  Inputs  used  in  conjunction  with  englneering/managament  Judgment 
to  make  the  apportionment  decision. 
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SECTION  VI 

CONCLUSIONS 


This  chapter  deals  with  tha  conclusions  and  observations  made  during 
the  study  and  is  divided  into  three  parts:  (I)  reliability  prediction 

methodology,  (2)  rel iabi 1 ity  optimization;  and  (3)  rellabi 1 1 ty  apportion- 
ment. 


A.  RELIABILITY  PREDICTION  METHODOLOGY 


I . Physical  Description 

Tha  component  level  of  the  system  description  is  the  lowest 
level  at  which  a high  degree  of  confidence  exists.  Examples  of  this 
level  are  the  Servo  Hydraulic  Drive  of  the  BCS,  the  Sustainer  Power 
Supply  of  the  EDL,  the  Aerodynamic  Window  of  the  GDL,  the  Nozzle  Bank  of 
the  CL,  and  the  Computer  of  the  FCS.  Unfortunately,  at  this  level  of 
detail  there  was  insufficient  data  available  In  the  failure  data  base  to 
be  able  to  calculate  any  reliability  point  estimates.  Thus,  it, was 
decided  to  carry  the  physical  description  one  level  further;  that  Is,  to 
the  parts  level  (e.g.,  hydraulic  pump  for  the  Servo  Hydraulic  Drive). 

The  criteria  used  for  determining  which  parts  were  used  to  describe  each 
component  were  twofold.  First,  the  part  had  to  belong  to  the  existing 
failure  data  base;  and  secondly,  the  part  had  to  belong  to  the  descrip- 
tion of  the  component  according  to  general  engineering  considerations. 
Thus,  only  parts  for  which  data  were  available  were  listed  under  each 
component. 

This  technique  for  building  the  parts  level  of  the  system 
description  was  based  upon  two  assumptions  (both  expedient  but  open  to 
question).  First,  it  was  assumed  that  alt  of  the  parts  were  connected 
In  series.  That  is,  no  one  part  was  more  or  less  Important  than  any 
other  part,  and  the  failure  of  any  one  part  would  lead  to  a failure  of 
that  component.  Second , it  was  assumed  that  the  list  of  parts  for  each 
component  completely  described  that  component.  Neither  of  the  assumptions 
is  completely  true,  so  the  parts  level  of  the  physical  description  Is 
technically  Inaccurate. 


2. 


Failure  Data  Base 


Tlmes-to-fal lure  data  were  completely  absent  from  the  available 
data  base.  That  is,  in  every  case  the  failure  data  were  summarized  such 
that  the  tlmes-to-fal lure  data  were  not  recorded.  Thus,  when  the  test 
was  recorded,  only  the  number  of  failures  and  the  number  of  part-hours 
of  testing  were  recorded.  As  will  be  discussed  later,  this  constrained 
the  model  to  the  exponential  failure  distribution. 

Many  of  the  parts  that  were  Judged  necessary  to  complete  the 
component  description  had  no  failure  data  available.  In  addition, 
several  of  the  components  could  not  be  described  in  terms  of  any  parts 
for  which  failure  data  were  available.  Thus,  these  components  could 
not  be  represented  by  parts,  so  their  reliabilities  were  assumed  to  be 
near  unity. 

Third,  the  parts  that  were  represented  in  the  failure  data 
base  were  not  well  identified.  For  example,  from  the  Identification 
of  the  parts,  the  capacity  of  a pump,  the  size  of  a valve,  or  the  rating 
of  a power  supply  could  not  be  determined.  Thus,  it  was  impossible  to 
determine  whether  or  not  the  part  chosen  from  the  data  base  was  actually 
applicable  to  the  HEL  component  under  consideration. 

Finally,  the  performance  and  test  environment  specification 
were  absent  or  inadequate  on  all  of  the  parts.  Thus,  one  could  not 
determine  what  performance  specifications  were  used  to  define  failure. 

3.  Effects  on  the  Model 

The  principal  effect  of  the  above  limitations  was  that  an 
exponential  distribution  had  to  be  assumed  since  failure  history  data 
were  not  available  to  determine  what  distribution  best  described  the 
failures.  The  exponential  distribution  is  a single  parameter  distribu- 
tion end  thus  is  used  universally  because  of  its  simplicity.  It  does 
not,  however,  very  accurately  represent  reel  world  failures.  It  does 
not,  for  example,  describe  such  real  world  effects  as  infant  mortality 
(burn-in  failures),  or  wearout.  However,  since  only  failure  rate  data 
are  available  in  all  of  the  data  banks  investigated,  one  does  not  have 
the  option  of  determining  which  distribution  best  fits  the  failure  data. 
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The  failure  criteria  of  the  failure  test  designer  was  assumed 
to  match  the  failure  criteria  of  the  HEL  system  since  these  criteria 
were  not  identified  In  any  of  the  data  bases.  Since  the  faiture  criteria 
of  the  data  base  were  completely  undefined,  It  was  assumed  that  they 
were  reasonable  in  their  application  to  the  HEL  system.  In  addition, 
the  concept  of  degraded  performance  at  the  part  level  was  completely 
precluded. 

Since  the  parts  In  the  data  base  were  not  adequately  identified 
nor  were  the  performance  or  environmental  specifications  identified,  it 
was  assumed  that  the  data  applied  completely  to  the  HEL  system.  Thus, 
the  accuracy  of  the  part  level  of  the  system  description  was  compromised 
severely. 

The  absence  or  limited  availability  of  failure  data  contributed 
to  the  large  variation  In  the  confidence  bounds  calculations  since  the 
number  of  observed  failures  In  the  testing  sequence  appears  as  a divisor 
in  the  confidence  bounds  expression.  Thus,  the  lower  the  number  of 
observed  failures,  the  larger  the  confidence  bounds  of  the  reliability 
point  estimates.  Since  some  of  the  failure  date  were  the  result  of  testing 
programs  In  which  a large  number  of  failures  were  reported,  and  other 
failure  data  were  the  result  of  programs  In  which  faw  or  no  failures 
were  reported,  the  value  of  the  confidence  bounds  Is  diminished  in  an 
engineering  sense. 

It  must  be  remembered  in  Interpreting  the  calculated  reli- 
ability point  estimates  that  they  should  not  be  used  to  compare  one 
HEL  or  subsystem  to  another.  The  limitations  imposed  by  the  failure 
data  base  would  render  such  comparisons  completely  Inappropriate. 
k.  Operating  Time 

Reliability  Is  a time  dependent  parameter;  that  Is,  it  is 
the  probdbtlity  of  successful  operation  for  a given  period  of  time. 

Thus,  when  reliability  point  estimates  are  calculated,  the  operating 
time  of  the  system  must  be  chosen.  A representative  operating  time  of 
the  HEL  system  was  difficult  to  choose  since  some  components  of  the 
system  operate  continuously  (e.g.,  threat  detection  and  acquisition 


components),  some  components  operate  during  the  engagement  (e.g.,  beam 
control  alignment  systems  and  digital  controllers),  and  still  others 
operate  only  during  the  firing  sequence  (e.g.,  nozzles  and  turbo  pumps). 
In  addition,  all  components  are  subject  to  loads  exerted  during  flight 
and  maintenance-generated  stresses.  Thus  the  reliability  calculations 
were  made  for  two  representative  times  — the  30-second  firing  time  of 
a mission,  and  a typical  tactical  mission  time  of  I hour.  Therefore, 
there  is  room  for  interpretation  in  the  definition  of  operating  time 
for  future  applications. 

B.  RELIABILITY  OPTIMIZATION  METHODOLOGY 


The  costs  and  benefits  which  Impact  the  reliability  decision  can 
be  analyzed  in  a mutually  consistent  and  logical  manner.  The  marginal 
costs/marginal  benefits  approach  is  well  suited  to  reliability  optimiza- 
tion since  optimization  Is  an  axtramum  problem,  and  the  marginal  approach 
defines  the  extremum. 

Three  problems  need  to  be  addressed  In  the  application  of  the 
reliability  optimization  methodology  to  the  HEL  system.  First,  the  LCC 
data  will  be  difficult  to  collect.  However,  one  must  remember  that, 
since  this  is  an  extremum  problem,  the  similar  system  (historical)  cost 
versus  reliability  data  need  not  be  accurate,  but  rather  the  shapes  of 
the  curves,  and  thus  the  derivatives,  must  be  accurate.  Thus,  so  long 
as  the  cost  data  behaves  similarly  with  respect  to  reliability  for  both 
the  similar  system  and  for  the  HEL  system,  the  minimum  cost  will  be 
experienced  at  approximately  the  same  value  of  reliability  for  both 
systems;  and  this  Is  the  ultimate  objective.  This  methodology  cannot  be 
used  to  decide  whether  or  not  to  develop  the  HEL  weapon  system  since 
that  decision  requires  a knowledge  of  the  absolute  cost,  not  just  the 
marginal  cost. 

Second,  the  appropriate  availability  model  must  be  chosen  to 
accurately  reflect  the  kinds  of  costs  and  maintenanca  which  would  be 
representative  of  a force  of  HEL  systems.  A number  of  such  models  are 
available  which  offer  a wide  range  of  features;  however,  the  actual 
decision  on  a specific  model  would  be  made  prior  to  its  application. 


Third,  the  combat  effectiveness  modal  which  was  developed  to  relate 
effectiveness  to  reliability  is  quite  simple;  however,  since  it  is  Just 
a single  variable  model,  it  should  be  reasonably  accurate  In  demonstrating 
the  effect  of  reliability  changes  on  the  chosen  measure  of  effectiveness. 

C.  RELIABILITY  APPORTIONMENT  METHODOLOGY 

The  reliability  apportionment  technique  and  its  associated  criticality 
ranking  rationale  are  very  useful  methodologies  to  aid  the  reliability 
budgeting  problem.  The  Failure  Modes  and  Effects  Analysis,  which  provides 
the  inputs  to  the  criticality  ranking,  is  an  essential  step  in  the  system 
design  for  both  reliability  and  system  safety  considerations.  Although 
the  emphasis  of  a fault  tree  analysis  for  system  safety  is  different  from 
that  for  a FMEA,  the  technique  and  the  required  understanding  of  the  system 
are  nearly  identical. 

The  criticality  number  derived  from  the  FHEA  reflects  the  true  Impor- 
tance of  a subsystem  or  component  once  it  has  failed.  Thus  the  criticality 
number  addresses  criticality  Issues  only  (i.e.,  portion  of  total  failures 
in  a particular  failure  mode,  probability  of  the  identified  effect 
actually  occurring,  weighing  of  the  Importance  of  the  effect  on  the  HEL 
system).  These  parameters  have  meaning  only  after  failure  has  occurred, 
whereas  reliability  predicts  the  probability  of  failure  before  It  occurs. 
The  separation  of  these  two  kinds  of  parameters  Is  essential  to  keep  one 
of  them  from  being  inadvertently  considered  twice  In  the  apportionment 
analysis. 

Finally,  the  apportionment  technique  Itself  provides  a consistent 
and  comprehensive  method  for  evaluating  the  entire  set  of  possible  ways 
of  achieving  the  system  reliability  objective.  Since  both  the  reli- 
abilities and  the  criticalities  can  be  ranked  independently,  they  can 
be  evaluated  and  weighed  separately  using  engineering  Judgment  or  can 
be  quantitatively  combined  using  soma  preconceived  weighing  schema. 

The  apportionment  methodology  does  not  presently  include  a means  of 
optimizing  the  combination  of  reliability  changes;  however;  the  technique 
suggests  the  use  of  such  optlmlzetlon  methods  as  linear  programming  to 
choose  the  bast  combination. 
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SECTION  VII 
RECOMMENDATIONS 


This  chapter  presents  recommendations  for  the  future  direction  of 
Laser  System  Reliability  analysis.  They  ere  based  upon  the  experience 
achieved  in  the  Laser  System  Reliability  effort  and  incorporate  the 
conclusions  described  In  chapter  II.  The  recommendations  have  been 
broken  down  into  four  separate  parts,  each  of  which  will  be  described 
Individually.  Thesa  four  parts  are: 

(1)  Model  construction  for  ALL  (Airborne  Laser  Laboratory)  or  LWS 
(Light  Ueight  System)  at  North  Oscura  Peak. 

(2)  Data  base  expansion. 

(3)  Sensitivity  analysis. 

(k)  Model  validation. 

Now  that  the  overall  methodology  for  Laser  System  Reliability  has 
been  developed.  It  should  be  applied  to  a well  defined  and  character- 
Izable  situation;  for  example,  the  ALL  or  the  LWS.  The  application  of 
the  physical  system  description  and  the  modeling  methodology  presented 
In  chapters  III  and  IV  to  the  LWS  will  result  In  a model  application 
which  will  present  an  accurate  and  realistic  test  case  of  the  methodolo- 
gies. To  construct  such  a modal  of  tne  LWS,  for  example,  would  require 
the  description  of  the  complete  LWS  system  down  to  the  parts  level. 

Care  would  have  to  be  taken  that  this  parts  lave!  description  Is  inter- 
nally consistent  and  complata. 

Following  the  model  construction,  the  data  base  expansion  would 
require  two  prime  tasks.  First,  an  examination  of  the  source  documents 
for  the  data  base  would  be  performed.  This  examination  would  be  used  to 
determine  whether  or  not  the  data  are  applicable  to  a HEL  system  in  terms 
of  both  performance  specifications  and  testing  environment,  and  whether 
or  not  sufficient  data  are  available  to  use  failure  distributions  other 
than  the  exponential.  The  second  task  would  be  to  Investigate  the 
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failure  data  or  reliability  estimate!  of  the  subsystem  and  component 
fabricators.  This  effort  would  both  uncover  existing  data  and  determine 
the  resources  required  v obtain  additional  data  experimentally.  This 
data  base  expansion  would  cover  all  of  the  parts  required  by  the  LWS 
system  description  performed  In  the  first  of  these  recommendations. 

The  third  recommendation  centers  on  an  analysis  of  the  sensitivity 
of  system  reliability  ;.o  both  the  physical  system  description  and  the 
failure  data  base  which  has  bean  constructed.  In  the  area  of  the  physi- 
cal system  description,  an  onalysls  of  the  sensitivity  of  reliability  to 
various  system  configurations  would  be  performed.  For  example,  one 
would  add  or  subtract  redundancies  or  reduce  the  number  of  parts  in  a 
component  and  then  trace  the  effects  of  these  changes  to  the  reliability 
estimate  for  the  subsystem  or  the  entire  HEL  system.  In  the  area  of 
failure  data,  an  analysis  would  be  performed  of  the  sensitivity  of  reli- 
ability to  either  the  failure  rate  or  the  sample  size.  The  failure  rate 
influerces  the  reliability  estimates  while  sample  size  Influences  the 
confidence  bounds  of  those  estimates.  One  could,  for  example,  change 
the  failure  data  sampla  size  of  critical  components  in  the  system 
description  to  determine  the  effect  of  that  sample  size  change  on  the 
confidence  of  the  reliability  estimates  for  the  HEL  system. 

The  objectives  of  the  sensitivity  analysis  have  both  short-term  and 
long-term  Implications.  The  short-term  implication  Is  that  it  should 
allow  the  analyst  to  optimize  the  data  collection  and  data  reduction 
techniques  for  the  LWS  failure  data.  In  the  long  run,  the  sensitivity 
analysis  could  be  used  to  determine  where  resources  could  best  be  spent 
for  further  physical  system  descriptions  and  failure  data  bases.  This 
long  range  objective  would  be  to  reduce  the  amount  of  wasted  effort  in 
future  physical  system  descriptions  and  failure  data  base  constructions 
by  directing  those  programs  only  in  the  directions  of  maximum  payoff. 

The  final  recommendation  involves  the  validation  of  the  model 
against  LWS  experience.  This  validation  phase  draws  very  heavily  upon 


the  sensitivity  ene lysis  phase  of  the  recdinmendatlons  since  the  success 
or  failure  of  this  validation  depends,  to  an  important  extent,  upon  the 
aval  lability  of  the  right  kinds  of  failure  data  from  the  LWS  experiments. 

The  overall  benefits  derived  from  these  four  recommendations  can  be 
summarized  as  follows.  The  application  of  the  reliability  methodologies 
in  an  accurate  and  complete  way  to  an  existing  HEL  system  would  provide 
a considerable  amount  of  credibility  to  the  modeling  procedure  and  would 
increase  its  value  In  the  long  run  in  terms  of  modeling  actual  HEL 
weapon  systems.  Since  the  ultimate  purpose  of  this  reliability  effort 
Is  to  provide  accurate  inputs  to  the  HEL  Management  Program,  it  is 
important  to  apply  the  reliability  methodologies  to  an  existing  system 
to  validate  those  developed  techniques.  The  ALL  and  the  LWS  are 
systems  which  reflect  the  complexity  and  the  general  engineering  con- 
siderations of  HEL  weapon  systems.  The  sensitivity  analysis  performed 
immediately  before  the  validation  phase  will  provide  significant  Insight 
Into  the  relationships  among  the  physical  system  description,  the  failure 
data  base,  and  the  reliability  model  which  would  be  important  In  future 
reliability  analyses.  In  addition,  the  application  of  LSR  techniques  to 
the  ALL  or  LWS  will  infuse  those  programs  with  very  significant  Insights 
into  their  data  management  tasks  so  that  important  data  will  be  easily 
accessible  and  will  reflect  the  requirements  of  both  the  experimenter 
and  the  high  level  manager. 
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Figure  A-l.  EDL  Functional  Block  Diagram 


["navigation  and  air-to-ground! 

! WEAPON  OELIVERY  SYSTEMS  j 
| (2  COMPUTERS)  I 
! (3  AMUX) 


INTERFACE 

LEGEND 

—■FLUID 

ELECTRICAL 


HiillMilR  BEAM 


--MECHANICAL 


Figure  A-3.  FCS  Functional  Block  Diagram 


TABLE  A- 1 . FCS  FAILURE  DATA  BASE* 


LOCATION 

UNIT 

FAILURE  RATE  (X10~6) 

VAN  INSTALLATION 

ALL  INSTALLATION 

ANTENNA/RANDOME 

22.9 

114.2 

TRANSMITTER 

118.6 

593.3 

MICROWAVE  ' 

121.5 

607.4 

RADAR 

FAIRING 

BEAM  STEERING 
CONTROLLER 

72.2 

360.8 

INSTALLATION 

LPRF 

211.2 

1,056.2 

POWER  SUPPLIES 

35.0 

175.4 

INS 

SUPPORT  STRUCTURE 

NOT  AVAILABLE 

NOT  AVAILBLE 

COOLING 

33.4 

33.4 

SUBTOTAL 

618.8 

2,940.7 

DISC  MEMORY 

192.3 

480.7 

TUTERFACE  ADAPTER 
UNIT 

210.5 

526.2 

RACK 

DIGITAL  ASSY 

1,451.7 

3,629.3 

A/D  CONVERTER 

16.4 

41.0 

PRE/POST  SIGNAL 
PROCESSOR 

321.6 

804.0 

POWER  SUPPLIES 

146.1 

365.1 

RACK  CABINET 

- 

- 

SUBTOTAL 

2,338.6 

5,846.3 

01  SPLAYS  l CONTROLS 

565.7 

2,828.8 

CONSOLE 

VIDEO  RECORDER 
CONSOLE  CABINET 

785.8 

1,964.6 

*» 

SUBTOTAL 

1,351.5 

4,793.4 

OTHER 

APT  BUFFER 

NOT  APPLICABLE 

17.8 

INS 

, V*  -~v- 

NOT  APPLICABLE 

MTBF 

232  HR 

73  HR 

*Westtnghous«  HELRATS  Phis*  0 Report  (Drift),  August  1976. 


APPENDIX  B 

FAILURE  RATE  DATA  BASE 


Abbreviations: 

Source  ID 

N - Nonelectronic  Reliability  Notebook* ** 

** 

G - GIDEP 
Envl ronwent 
G - Ground 

S * Ship  or  submarine 
H * Helicopter 
A - Aircraft 
L - Laboratory 

NOTE:  Asterisk  (*)  on  data  means  that  failure  rate  has  been  recalculated 

correctly  from  GIDEP  data. 


*Nonelectronlc  Reliability  Notebook.  RADC-TR-75~22,  1975* 

**Summarles  of  Failure  Rate  Oata,  volume  1,  GIDEP,  August  1975. 
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SERVOL  HYDRAULIC  DRIVE  SYSTEMS 


FAILURE,  PER  10°  PART  - CYCLES 


APPENDIX  C 

DERIVATION  OF  PSEUDONUMBER  OF 
TRIALS  APPROXIMATION 

For  the  exponential  distribution 

1 .*/0 

t~y  e , t>0 

0 ’ - 


and 

R<t)-5t/e 


where 


t • time 
6 — 1/A  - MTBF 
X ■ failure  rate 

A point  estimate  of  reliability  Is  given  by 


R(t)-; 


t/0 


where 


0 tj/n  - T/n 
t-1 

It  Is  known  that  2n0/0  x*(2n).  Thus,  P 


6>-P 


x;«») 


I -a,  Is  a one's  I dad 


confidence  Interval  for  0,  where  P[a>b]»probabtl Ity  that  a >b. 
A two-sided  confidence  Interval  on  1/0  Is  given  by 

2 


P 

2 


r xl-a/2(2n^  < 1/Q^xa/2(2n) 


'X 

2n0 


2n0 


L#t  C2  " V2  (2n/2n5. 

Now,  0 and  c,  are  known  from  the  data  base; 

But  n and  •r*  001  known.  To  circumvent  this  difficulty, 

apply  the  Wllson-Hllferty  approximation 

13 


xa/2(2n)/2n 


1"  ■ 


TO 


e/2 


y2/9(2n) 


127 


I 


where  *a/2  is  the  100  a/2  percentage  point  of  the  normal  distribution  function. 

, r 13 


i,  c2  ■ 4-  £l-2/9(2n)  ♦ za/2  /2/9(2n) 


■«[' 


l-2/9(2n)  ♦ *a/2y2/9(2n) 


Since  all  the  confidence  Intervals  on  X are  90  percent  intervals,  z^2  m 

*a/2  - '.05  * , MS- 


Squaring  and  combining  terms,  gives 


n-i/  -9  1 2 [(C2/i),/!-l]  - (|.M5)J  |±jij2[(c2/1j/J  -l]-(l.M5): 


♦*[(‘2A)2/3+2(c2/x),/3  -l]j 


APPENDIX  D 

LOWER  CONFIDENCE  BOUNDS  CALCULATIONS 


The  fundamental  reliability  equations  for  the  respective  kinds  of  HEL 
systems  are: 


6g<5)“«g(5>«b(5)»f(5> 

% 

6c(5)“9c(5)98^)9p^3) 

GE(R)-gE(R)gB(R)gF(R) 


where  the  g(R)'s  are  the  reliability  functions  of  each  of  the  major  systems 
and  are  given  by  g^Rj-RjRjRjR^Rjtl-O-R^)  (1-Ry) ]R8tj^  (^^°)Rgl  (1“R^°°  *]R 

9B(?)"Ri3R|i,Ri5l  J^(  l JRjjO-Rjg)^  ^RI7R|8R19R20R21 1 1 1 "R22^  ^ 1 ”R23^  ^ R24 

9p(8)“R25R26R27R28R29R30R3l  d'O'Rjj)  [l-d-Rjj,)  ^’835)1*3^37 

6C(5)-R38R39,Wb  1 1 1 “ ( 1 ’Rli2)  ( 1 “rJ»3>  H I - 0 -R44)  ( 1 -R45)  J R|,6 
188  ,188,. I „ . \ 188-1. 


lRWR49R50R51R52R53 


gE  (r)-r5^r55r56r57r58r53r6or61  r62r63r61|r65r66r67r68r69 

The  following  relations  hold  for  the  GDL,  In  general,  except  for  terms 
Involving  R^,  R^,  Rj8»  R22*  R23*  *32’  ^JJ*  R34*  R35* 


12 

Spi  v.r(i,).  fkJJ  («) (b) (c)  (d) (•) (,)  [lr*JJ/n, 

I J J.l  L 

J 1*6, 7, 9, 16, 22, 23, 32, 33, 3b, 35 

1 

v.r(i„>.  ”[*}]  (a)  (b)  (c)  (d)  (a)  (f)  ^1  "Rjy]  2/n37 
J-1 

J 1*6, 7, 9, 16, 22, 23, 32, 33,3*>, 35 


where 


2 


J»*6.7.9. 16,22,23, 
32.33.34,35 


Ji*6, 7.9.16, 22, 23, 32,33, 34, 35 


The  remaining  partial  derivatives  must  be  found  separately. 
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(»)(c)  (d)  (e) (f)/ng 

j 1*6,7,16,22, 23, 32,33,3*.  35 


[ (.)(b)(d)(«)(f)/nl6J 

J»*6, 7, 9, 22, 23, 32, 33, 1*.  35 


U)(b)(c)(*)(f)/n22 


(a) (b) (c) (d) (f)/n, 


33 
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(a)  (b)  (c)  (d)  (e)/n 


J 1*6, 7, 9, 16, 22, 23, 32 ,33, 35 


3*» 


T^T  V‘r("3s)*  ["*»]  [’-*3*]  <•)<■>> («■><•)/" 

J 1*6, 7, 9, 16, 22, 23,32,33,3*» 


Similar  ralations  wara  obtained  for  tha  CL  and  the  EDI  systems. 

That#  ralations  wara  than  addad  together  to  form  tha  laft  hand 
si da  of 

2 

Var  ftj  ■ G(K)  |l-G(A)j/n. 

G (ft)  and  l-G(A)  wara  obtainad  and  n was  than  calculatad  for  tha  thraa  HEL 
systams  for  aach  of  two  operating  tlma  parlods;  t-30  sac  and  t-3600  sac. 

For  caicuiation  purposes  ft  was  decided  to  break  down  each  system 
Into  subsets  which  wara  common  to  all  systams  and  had  similar  computational 
forms.  For  example*  g(  and  gp  are  terms  common  to  all  thraa  systams. 
Additionally,  quantities  of  tha  general  form 

(1)  (*,)(A2)(A3)...(An) 

(2)  [I  - (I  - A#)(l  - Ab)l 

<j>  E (?)*'(!  - «)"■' 

I 1 

ara  common  to  all  tha  five  major  subsystems,  gQ,  t , g£,  g#,  and  gp. 

Thus,  tha  calculations  wara  obtainad  In  these  forms  and  subsets,  than 
summed  for  aach  HEL  system.  To  be  specific, 
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mmm 


For  t - 30  sec. 


L - 2 
6 j 


3Cq  (R) 


1 2 


3R 


J 


VortRj) 


- L (A| ) ♦ 1(A2)  ♦ L(Aj)  ♦ L (B | ) ♦ 

• 6.0481 136  x 10*'3  ♦ 8.6325393  x 

+ 1.0289/81  x 


L(B2)  ♦ L(B3)  ♦ L(F) 

lo“n  + 0 + 4.0066856  x lo'8 
10* 16  ♦ 0 ♦ 4.573672  x 10*8 


- 8.5890507  x 10*8 


where  L(A|),  L(Aj) , L(Aj)  are  terms  of  the  form  (I),  (2),  (3) 
respectively  in  the  GDI;  l(Bj),  L(B2),  L (B^)  ere  terms  of  the  form  (I), 
(2),  (3)  respectively  In  the  BC0  subsystem  and  L9F)  represents  the  FCS. 


L 


C 


rK  (r) 

j p*r 


2 

Var(Rj) 


- L(Cj)  ♦ L(C2)  ♦ L(Cj)  ♦ L(Bj)  ♦ L(B2)  ♦ KBj)  ♦ L(F) 

- 9.986852  x !0’5  ♦ 1.726518  x 10*10  e 1.0  x 10*U 

♦ 4.0066856  x 10*8  ♦ 1.028978  x 10*16  ♦ 0 ♦ 
4.573672  x I0*8 


9.596308  x 10 


•8 


where  l(Cj),  L(C2),  L(C^)  are  terms  of  the  form  (I),  (2),  (3) 
respectively  In  the  CL.  l(Bj),  l(l2),  L (B^) • and  L(F)  are  as  above. 

2 


4-  r 
f j 


V 


J 


Var  (Rj) 


L (E| ) ♦ L(E2)  ♦ UEj)  ♦ L (B , ) ♦ L(»2)  ♦ L(Bj)  ♦ L(F) 

x 
•8 


- 2.263538  x 10*8  ♦ 0 + 0 ♦ 4.0066856  x 10*8  ♦ 1.028978  x 10*16 


+ 0 ♦ 4.573672  x 10 


1.0843889  x JO*7 
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Wh«r«  L(Ej),  L(E2),  L(Ej)  ir«  terms  of  the  form  (1),  (2),  (3) 
respectively  for  the  EDL. 


For  t • 3600  sec. 


lg  -U 

c y* 


K (a) 


a r. 


Ver  (Rj ) 


- L(A,)+  L(A2)+  L(A3)+  L(B, )♦  L(B2)+  L(B3)+  Iff) 

- 7.999183  x 10  3 ♦ 1 . 136424  x lo"6  4-  1.020510  x lo"*1 

♦ 1.661103  x 10"6  4*  1.722335  x lo"12  ♦ 0 * 
6.050557  x I O'* 

- 7.099100  x 10‘* 


V 3CC  ^ 
“ “I! 

J 3*J 


Ver  (Rj) 


- L(C,)  ♦ L(C2)  ♦ L(C3)  4-  L(B,)  4.  L(B2)  ♦ L(Bj)  4-  L(F) 

- 2.032451  x I0”8  ♦ 5.133400  x 10’H  ♦ 1.897151  x 10‘2 

4-  1.661103  x 10"6  4.  1.722335  x 10“12  4-  0 
♦ 6.050557  x I0“4 

- 1.957825  x 10"2 


L 


2 

j 


Ver  (Rj) 


- L(E,)  ♦ L(E2)  ♦ L(Ej)  ♦ L(Bj)  4.  L(B2)  ♦ L(B3)  ♦ L(F) 

• 6.872963  x lo’3  4 0 + 0 4 1.661103  x lo“6  4.  1.722335  x 10“12 
♦ 0 4-  6.050557  x 10’* 

- 7.479680  x 10*3 
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Since  the  equations  are  large  and  cumbersome,  a programmable  HP-67 

A 

was  used  to  obtain  the  n's  for  each  of  the  six  situations. 


RESULTS  OF  THE  CALCULATION  WERE: 


t • 30  sec 


t ■ 3600  sec 


These  results  were  then  used  to  determine  the  95  percent  lower  con* 
f I dance  bounds  on  the  HEL  systems  given  In  chapter  IV. 


APPENDIX  E 

COMBAT  EFFECTIVENESS  ALGORITHM 


A.  INTRODUCTION 

This  appendix  provides  an  algorithm  for  first  order  estimates  of 
the  effects  of  HEL  reliability  on  HEL  airborne  combat  effectiveness. 
Pages  50  to  55  are  repeated  here  for  completeness. 

B.  AN  ALGORITHM  FOR  FIRST  ORDER  ESTIMATES 


The  algorithm  presented  herein  enables  first  order  estimates  of  laser 
reliability  on  outcomes  of  aerial  combat  between  a laser  armed  at  reraft  and 
an  attacking  alrr.raft  employing  any  feasible  number  of  AAM's  or  gun  firing 
attempts.  Enemy  SAM  attacks  on  the  laser  armed  aircraft  are  also  accomo- 
dated, as  well  as  any  reasonable  number  of  successive  encounters.  Friendly 
and  enemy  aircraft  kill  probabilities  are  directly  computed,  enabling  direct 
determination  of  values  of  such  MOE's  as  the  exchange  ratio  (ER). 

We  start  with  tha  following  definitions  of  terms: 

defensive  hassle  ■ an  encounter  between  a laser  armed  aircraft  and 

any  feasible  number  of  successive  attacking 
SAM's  or  AAM's,  or  gun  firing  passes.  A defen- 
sive hassle  terminates  prior  to  the  next  offen- 
sive laser  shot,  e.g.,  a laser  shot  at  the 
enemy  aircraft. 

offensive  hassle  ■ one  or  more  laser  shots  at  the  enemy  aircraft. 

The  offensive  hassle  terminates  prior  to  the 
next  defensive  hassle. 


Figure  E-l  presents  the  generic  probability  probability  tree  diagram 
for  the  kill  calculations  algorithm.  Note  that  the  order  or  number  of 
offensive  and  defensive  hassies  is  arbitrary,  since  we  may  set  certain 
input  parameters  to  values  such  that  non-occurring  hassles  indicated  on 
the  Figure  E-l  are  accounted  for,  retaining  algorithm  validity. 

Let 

Rj  ■ laser  reliability* *  for  the  I***  laser  firing, 

P ■ probability  that  the  laser  kills  the  threat,  on  Ith  laser 
1 firing 


For  the  J***  offensive  hassle  (see  figure  E-i),  we  define: 

• t » probability  that  laser  does  not  kill  the  enemy  aircraft, 

J fk 

and  laser  Is  operable  at  end  of  J offensive  hassle; 

given  surviving  and  operable  later  and  laser  armed  air- 
craft at  start  of  Jth  offensive  hassle; 

Ft  ■ probability  that  later  does  not  kill  the  enemy  aircraft, 

• * L 

and  laser  It  Inoperable  (failed)  at  end  of  J offensive 
hassle;  given  surviving  and  operable  laser  and  laser  armed 
aircraft  at  start  of  Jth  offensive  hassle; 

Ej  ■ probability  that  laser  kills  the  enemy  aircraft,  given 
surviving  and  operable  laser  and  later  armed  aircraft  at 
start  of  the  Jth  offensive  hassle; 
and 

•j  • *jfj 

Fj  - fj 

lj  • »/j  . 


* Th.  Ith  ftrin,  ts  of  tint  duration  t.»  and  F| 

Ions  for  6(R)  described  in  Chapter  IV. 


ts  determined  from  express 
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Figure  E-l.  Generic  Probability  Tree  Diagram  for  Kill  Calculations  Algorithm 


and 


0j  ♦ Fj  + Ej  ■ 1.0,  as  required. 

We  note  that  if  tha  first  hassla,  for  example,  Is  a defensive  hassle, 
we  sat  0j  ■ 1.0,  Fjb  - 0.0. 


In  order  to  calculate  the  outcomes  of  defensive  hassle  2,  or  indeed  of 
any  defensive  hassle,  we  will  now  derive  several  outcome  probability  rela- 
tions associated  with  the  defensive  hassle. 

We  define: 


W,  • 1 - (SSPK  of  the  Ith  threat  in  a defensive  hassle*); 


7|  ■ 1 - W|S 


Pj  ■ probability  that  the  laser  armed  aircraft  survives  the 


Ith  threat,  and  Is  reliable,  given  reliable  laser  and 

(th 


laser  armed  aircraft  at  start  of  1 
In  a defensive  hassle; 


threat  encountar 


then: 


,, . *tp,  ♦ 


and  we  define: 


*. ' V. 


Note  that  the  relleblltty  of  a threat  SAM  or  AAM  Is  usually  Included  in 
the  mlssle  SSPK,  since  each  such  weapon  Is  only  employed  once.  However, 
the  laser  can  be  employed  repeatedly,  requiring  explicit,  detailed  treat* 

hj  A * ' { - ')  " \ 1 A * ' 

mer.t  of  laser  reliability  at  follows. 
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Figure  E-2  presents  the  generic  probebility  tree  diagram  for  calculating 
S|j,  where: 

S.,  - probability  that  the  laser  armed  aircraft  survives  the  1st, 

• th 

and  the  2nd,  and  the  3rd, and  the  i threat  of  the 

j**1  defensive  hassle;  in  operable  or  non-opersble  state; 

given  that  the  laser  is  operable  and  laser  armed  aircraft 

is  operable  at  start  of  the  Jth  defensive  hassle. 


From  figure  E-2,  we  see  that: 

Sjj  ■ Pj  + i (J)  * 

when  the  (J)  symbol  indicates  that  the  parameters  of  the  RHS  of  the 
equation  are  evaluated  for  the  defensive  hassle,  and 


S2J  “ plp2  * p1*2  * *|W2 

$3J  ’ ptp2p3  * plp2*3  * p1*2M3  * *tW2W.j  (J)- 

**J  ' ptp2p3p*  + P1P2P3*4  * plp2i3W‘i 
♦ P!*2W3WJ»  * *iW2W3W*  (J)p 


and,  from  the  perceived  pattern: 
S 


he  perceived  pattern: 

n /n-l  v /n-2  \ 

nj  ■ niip,/*,  ♦ in  p 

i-i  i-i  i-i 

Crip)*„-2  (ft  «,) 

1-1  l-n-1  ' 

(fi ..)  (ft  »,) 

1-1  I -n-2 
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Figure  E-2.  Generic  Probability  Tree  Diagram  for  Laser  Armed  Aircraft 
Survival  in  a Defensive  Hassle 


j 


n 


♦ ...  + z , n Wn  ; (J), 

1-2 

with  nj£2,  integer  ..  (For  n-1 , Sjj  ■ pj  + 2j), 

For  example,  with  n-6: 

S6J  ' plp2p3p4p5p6  * ptp2p3p4p5i6 

+ P,P2Pj»^5«6  ♦ p,v,**v* 

+ PjPjEjW^WjWj  + PjIjMjM^WjWj 

* !i¥)Vs“i  » (j) 

whore,  egein,  the  (j)  symbol  implies  thet  the  paremeters  of  the  RHS  of  the 
equation  have  values  for  the  Jth  defensive  hassle. 


Lj  ■ probability  that  the  laser  armed  aircraft  Is  killed  on  the  Jth 

defensive  hassle,  given  that  laser  and  laser  armed  aircraft  are  sur- 
vtvlhg  and  operable  at  start  of  the  Jth  defensive  hassle: 
then,  from  the  definition  of  $nj  end  Lj  : 

|lj  - 1 - SnJ]  (defensive  hassles  only) 


th 

Fj  ■ probability  that  tha  laser  survives  the  j defensive  hassle  and 
In  a failed  state,  given  that  the  laser  and  laser  armed  air* 
craft  are  surviving  and  operable  at  the  start  of  the  Jth  defens- 
ive hassle; 


then,  from  the  definition  of  Fj  and  P|  and  $nj: 


Let 

0j  ■ probability  that  the  laser  survives  the  Jth  defensive  hassle  and 
In  an  oparable  state;  given  that  the  laser  and  laser  armed  air* 
craft  are  surviving  and  operable  at  the  start  of  the  Jth  defensive 
hassle, 

then,  from  the  definition  of  p| ; 


and:  Lj  * • t .0*  as  required. 

Let 

L2  ■ probability  that  the  laser,  surviving  hassle  I but  In  a failed 
condition,  Is  killed  on  defensive  hassle:  2,  or  k,  or  6 
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■«**!!* 





we  have: 


then  for  H2  threats  In  hassle  2,  threats  In  hassle  *t,  ...» 

V'-(n «,Xn  w,)(n «,)  - 


M 

‘ !■! 

M 

not 

not 

not 

killed 

killed 

killed 

on 

on 

on 

Hassle 

Hassle 

Hassle 

2 

k 

6 

Finally,  with  all  values  of  ij,  Fj,  Ej , Lj  and  L calculated  from  the 
above  relations,  we  let: 

Kg  ■ probability  that  the  enemy  aircraft  Is  killed 

Kg  ■ probability  that  the  friendly,  laser  armed  aircraft  Is 
killed, 

and  referencing  Figure  1,  we  see  that: 


Kg  - E,  ♦ §j«2E3  ♦ ♦ ... 

K«  * F1~2  * ®1L2  * #1L2  + 01F2^4  + 6162F3Lj*  + G I *2*3^4  * 


where  the  Kg  and  Kg  are  derived  from  listing  the  mutually  exclusive,  ex- 
haustive ways  In  which  the  kills  can  occur. 

We  can  then  compute  ER  • exchange  ratio,  where 


pertaining  to  repeated  occurrences  of  a scenario  having  the  specified 
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hassles,  hassle  sequence  and  hassle  parameter  sets. 

Appendix  F provides  two  worked  examples  for  a defensive,  offensive, 
defensive  hassle  sequence;  with  2 AAM's  as  threats  In  each  defensive  has 
sle;  with  ohly  HEl  reliability  varied  between  examples.  ( NOTE:  Any 

offensive/defensive  hassle  sequence  Is  accomodated  by  the  algorithm). 


APPENDIX  F 

COMBAT  EFFECTIVENESS  EXAMPLES 
HASSLE  SEQUENCE:  DEFENSIVE,  OFFENSIVE,  DEFENSIVE. 

EXAMPLE: 

PROBLEM  I.  GIVEN: 


Hassle  1.  offensive:  Do«s  not  occur,  thus: 


B,  - 1.0 

Fj  - 0.0 
Ej  ■ 0.0 

Hassle  2.  defensive:  2 AAM  throats: 


CO 

• 

o 

■ 

P,  - 0.95 

R,  - 0.90 

V2  - 0.7 

P2  - 0.97 

R2  • 0.93 

Hass I a 3.  offensive: 

Rj  ■ 0.90 
Pj  - 0.98 

Hassle  k,  defensive:  2 AAM  threats: 

V,  « 0.9  P,  - 0.98  A,  * 0.92 

V2  - 0.85  P2  ■ 0.99  R2  - 0.92 
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Solution 


Step  1:  We  Just  compute  the  values  of: 
Sj2»  $22’  *14*  $24*  **  follows: 


For  S| 2 : 


S|2  (2) 


l, 


p,  • «,P,  ♦ . 


thus: 


|k,  • (. 10) ( .8)  - .0S|  , 


Pl  - A|P|  ♦ A^W, 


- (.90H.95)  ♦ (.90)  (.05)  (.8) 

- .8550  ♦ .360 


jpj  ■ .8910J 


S?2  ■ .8910  ♦ .800 


[S.2  * •”">] 


For  Sjj! 


S22  ’ * "1*2  * *1W2  (2) 


pj  ■ .8910  from  S|2  calculations 


Z|  ■ .08  from  Sj2  calculations 


V2  * *2*2W2 


(.93) (.97)  ♦ (.93) (.03) (.7) 


.902)  ♦ .0195 


.9207] 


4 ?&■•* 





f , v + 


'••itWSfc 


*2  “V* 


• • 


(.07) (.7) 

.049  j 

(.8910) (.9207)  ♦ (.8910) (.049)  ♦ (.08) (.70) 
.8203  ♦ .0437  ♦ .0560 
.9200*1 


For  S 


14* 


'14 


Pi  ♦ 


(4) 


I,  - , 

P1  - AjPj  ♦ • 


thus: 

ja,  - (.08) (.9)  - .072J 

- (.92)  (.98)  ♦ (.92)  (.02)  (.9) 
• .9016  - .0165 
[p,  - .9181 J 

and: 

Su  - .9181  ♦ .0720 

[*m  - •*»'] 


<* 
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For  S2l|: 


S2*  - f\?i  * Pl*2  * *1W2  <*> 


.pt 

■ .9181,  from  calculations 

.072,  from  calculations 

*2 

JT,W, 
2 2 

(.08) (.85) 

b 

.068  j 

"2 

R2P2+  *2F2  W2  " <*92)<*W)  + 

.9108  ♦ .0078 

[p2  ■ 

.9186 j 

*2*' 

(.9181) (.9186)  + (.9181) (.068) 

S2*  ' 

• 8Ji3^  + .0626  + 0612 

[S2V‘ 

.9670 j 

Step  2:  Compute  and/or  list  9y  Fy  Ej,  Lj, 

•j  ■ 1.0,  given; 

Fj  ■ 0.0,  given; 

E|  ■ 0.0,  given; 


U9 


(.92) (.01) (.85) 


♦ (.072) (.85) 


.j,  for  all  J; 


.9200  - (.8910)  (.9207)  - .9200  - .8203 
.0997]  ; 

ft’. 

1-1 

.8203]; 

AjFj  - (.90) (.02) 

.018]  ; 


• .10]  ; 

y3  - (.90) (.98) 
.882] 


*■  • "(!?,  ■■)(?,  •■) 

- ' - [(.8)(.7)J^(.9)  (.85)1 

- 1 - (.56) (.765)  - 1-. 1*284 

[l2  - .5716] 

h,  " I ‘ $2*  - 1 - .9670 

[t*  - .033] 


St«p  3. 


Compute  and  1^: 


**  " Ei  * ijOjEj 

• 0 ♦ (1.0) (.8203) (.882) 

[\  - •»»] 

S ' flC2  * »IL2  * *1^  ♦ •|,2F3S  * VjV* 

- (0) (.5716)  ♦ O.o) (.08)  ♦ (1.0) (.0997) (.033) 

♦ (1.0) (.8203) (• 10) (.235)  «■  (1.0) (.8203) (.018) (.033) 

• 0 ♦ .08  ♦ .0032  ♦ .0193  .0005 
[k,  - .1030] 
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Step  *.  Compute  ER 


[eR  - 7.02*  ] 


PROBLEM  2.  GIVEN: 

Seme  es  Problem  1,  except  Rj  ■ R^  • 1.0  for  Hassle  2;  and  Rj 
for  Hassle  *;  and  R^  ■ 1.0  for  Hassle  3* 


Solution: 


Step  1:  Calculate  $J2,  S^,  and  $2J| 


For  S.,: 


*u  • "l  ♦ »l  (J> 

i,  -v, 

»i  *v,*riVi 


thus: 


(0) (M})  - o] 


• (l>(.95)  ♦ 0)(.05)(.l) 
- .)5  ♦ .0* 


.99  ♦ 0 
.99] 


.99,  from  Sj2  calculations 


0,  from  Sj2  calculations 

HjPj*  HjFjWj 

(1 ) (-97)  ♦ OX. 03)1.7) 

97  ♦ .021 
• 991  ] 

T2W2“  <w2>  * 0 

(.99) (.990  ♦ (.99) (0)  ♦ (o)(W2) 
.98lt] 


P,*  i|  <*) 

F,V,-  (0)  (W| ) • 0 ] 

*1 V RjFjW, 

(1 ) ( .98)  ♦ (1 ) (.02) (.9)  - .98  ♦ .018 


For  S21|: 


*2*.  ' W *1*2  * *IW2 

-p,  ■ .998,  from  $..  calculation, 


Z|  ■ 0,  from  calculation; 
p2  - »2P2  ♦ */2w2 


(1H.99)  ♦ (1) (.01) (.85)  - .99  ♦ .0085 


'2  " ‘ 


9985] 


S2l>  - (.998) (.9985)  ♦ (.998) (0)  + (0) (W2) 
[s2%  - .9965] 

Stap  2.  Computa  List  0j,  Fj,  Ej,  Lj,  Lj,  for  all  J. 

Of  ■ 1.0  , glvan 

F|  ■ 0.0  , glvan 

Ej  • 0.0  , glvan; 


’ - *22  - ’ 


.owl 

*nf] 


- (.99) (.991) 


.0099 


;j 
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2 

[ ®2  -np.  ■ '98"  ] 

i-i 

[e3  " r3^3  " 0) (.02)  - .02] 

[r,  - V 0] 

jkj  - Y3"  (0  (.98)  - .98] 

Lj  ■ >5716,  (same  as  for  previous  example  problem); 

Lj|  - .235*  (same  at  for  previous  example  problem), 

Li»  " 1 - s24  " 1 ‘ *9365 

[l4  - .0035] 

Step  3<  Compute  Kg  and  K^: 

S *E1*W} 

- 0 + (1.0)(.9811)(.98) 

[s  --*15] 

*»  • F|~2  + *1L2  * Wk  + Wj1* 

- (oH.5716)  ♦ (1.0)  (.009)  ♦ (1.0)  (.0099)  (.235) 

♦ (1 .0) (.981 1) (0) (.235)  ♦ (1.0) (.981 1) (.02) (.0035) 
« 0 ♦ .0090  ♦ .0023  ♦ 0 * .0001 
[k,  • .Oin] 
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